Apr 14 02:53:57 user cinder-volume[73303]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73303) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 02:53:57 user cinder-volume[73303]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73303) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 02:53:57 user cinder-volume[73303]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73303) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 02:53:58 user cinder-volume[73303]: INFO dbcounter [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] Registered counter for database cinder Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_db.sqlalchemy.engines [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73303) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG dbcounter [-] [73303] Writer thread running {{(pid=73303) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 02:53:58 user cinder-volume[73303]: INFO cinder.rpc [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 14 02:53:58 user cinder-volume[73303]: INFO cinder.rpc [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_db.sqlalchemy.engines [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73303) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 02:53:58 user cinder-volume[73303]: INFO cinder.volume.manager [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] Determined volume DB was empty at startup. Apr 14 02:53:58 user cinder-volume[73303]: DEBUG cinder.volume.manager [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73303) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Apr 14 02:53:58 user cinder-volume[73303]: INFO cinder.volume.manager [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 14 02:53:58 user cinder-volume[73303]: WARNING stevedore.named [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 14 02:53:58 user cinder-volume[73303]: WARNING castellan.key_manager [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 02:53:58 user cinder-volume[73303]: WARNING cinder.keymgr.conf_key_mgr [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_db.sqlalchemy.engines [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73303) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 02:53:58 user cinder-volume[73303]: INFO cinder.rpc [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 14 02:53:58 user cinder-volume[73303]: INFO cinder.rpc [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. Apr 14 02:53:58 user cinder-volume[73303]: WARNING stevedore.named [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 14 02:53:58 user cinder-volume[73303]: WARNING castellan.key_manager [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 02:53:58 user cinder-volume[73303]: INFO cinder.volume.manager [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] Image-volume cache enabled for host user@joviandss-2. Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_db.sqlalchemy.engines [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73303) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 02:53:58 user cinder-volume[73303]: INFO oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] Starting 1 workers Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] Started child 73403 {{(pid=73303) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] Full set of CONF: {{(pid=73303) wait /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:649}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] ******************************************************************************** {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] Configuration options gathered from: {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] ================================================================================ {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] allow_availability_zone_fallback = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] allow_compression_on_image_upload = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] allowed_direct_url_schemes = [] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73403]: INFO cinder.service [-] Starting cinder-volume node (version 22.1.0) Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] api_rate_limit = True {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] auth_strategy = keystone {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] az_cache_duration = 3600 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_availability_zone = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_host = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_name = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_stats_polling_interval = 60 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backup_api_class = cinder.backup.api.API {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backup_name_template = backup-%s {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backup_use_same_host = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backup_use_temp_snapshot = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] chap_password = **** {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] chap_password_len = 12 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] chap_username = {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cinder_internal_tenant_project_id = 26e1e7b31d8647499d4f6edae9f171df {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cinder_internal_tenant_user_id = 9b3e6f4a34ed4311a696db171184670a {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cloned_volume_same_az = True {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cluster = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] compression_format = gzip {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] compute_api_class = cinder.compute.nova.API {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] config_dir = [] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] config_source = [] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] control_exchange = openstack {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] debug = True {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] default_availability_zone = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] default_group_type = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] default_volume_type = joviandss-2 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] driver_client_cert = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] driver_client_cert_key = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] driver_data_namespace = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] driver_ssl_cert_path = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] driver_ssl_cert_verify = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] driver_use_ssl = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] enable_force_upload = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] enable_new_services = True {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] enable_unsupported_driver = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] enabled_backends = ['joviandss-2'] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] enforce_multipath_for_image_xfer = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] filter_function = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] glance_api_insecure = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] glance_api_servers = ['http://10.0.0.210/image'] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] glance_api_ssl_compression = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] glance_ca_certificates_file = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] glance_catalog_info = image:glance:publicURL {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] glance_certfile = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] glance_keyfile = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] glance_num_retries = 3 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] glance_request_timeout = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] goodness_function = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] graceful_shutdown_timeout = 5 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] group_api_class = cinder.group.api.API {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] host = user {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] iet_conf = /etc/iet/ietd.conf {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] image_compress_on_upload = True {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] image_conversion_address_space_limit = 1 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] image_conversion_cpu_limit = 60 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] image_conversion_disable = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] image_upload_use_cinder_backend = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] image_upload_use_internal_tenant = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] image_volume_cache_enabled = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] image_volume_cache_max_count = 0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] image_volume_cache_max_size_gb = 0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] init_host_max_objects_retrieval = 0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] instance_format = [instance: %(uuid)s] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] iscsi_iotype = fileio {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] iscsi_target_flags = {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] iscsi_write_cache = on {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] iser_helper = tgtadm {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] iser_ip_address = 10.0.0.210 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] iser_port = 3260 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] jovian_block_size = 64K {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] jovian_ignore_tpath = [] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] jovian_pool = Pool-0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] jovian_recovery_delay = 60 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] log_config_append = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73403]: INFO cinder.volume.manager [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Starting volume driver JovianISCSIDriver (1.0.2) Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] log_dir = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] log_file = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] log_options = True {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] log_rotate_interval = 1 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] log_rotate_interval_type = days {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] log_rotation_type = none {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] check pool {{(pid=73403) is_pool_exists /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:71}} Apr 14 02:53:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] max_age = 0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] max_logfile_count = 30 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] max_logfile_size_mb = 200 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] max_over_subscription_ratio = 20.0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] message_reap_interval = 86400 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] message_ttl = 2592000 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] migration_create_volume_timeout_secs = 300 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] monkey_patch = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] monkey_patch_modules = [] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] my_ip = 10.0.0.210 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] no_snapshot_gb_quota = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] num_iser_scan_tries = 3 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] num_shell_tries = 3 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] num_volume_device_scan_tries = 3 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] nvmeof_conn_info_version = 1 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] nvmet_ns_id = 10 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] nvmet_port_id = 1 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] osapi_max_limit = 1000 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] osapi_volume_ext_list = [] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] osapi_volume_listen_port = 8776 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] osapi_volume_use_ssl = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] osapi_volume_workers = 3 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] per_volume_size_limit = -1 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] periodic_fuzzy_delay = 60 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] periodic_interval = 60 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] public_endpoint = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] publish_errors = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] quota_backup_gigabytes = 1000 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] quota_backups = 10 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] quota_consistencygroups = 10 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] quota_gigabytes = 1000 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] quota_groups = 10 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] quota_snapshots = 10 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] quota_volumes = 10 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] rate_limit_burst = 0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] rate_limit_except_level = CRITICAL {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] rate_limit_interval = 0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] reinit_driver_count = 3 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] replication_device = **** {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] report_discard_supported = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] report_interval = 10 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] reservation_clean_interval = 86400 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] reservation_expire = 86400 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] reserved_image_namespaces = [] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] reserved_percentage = 0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] rpc_response_timeout = 120 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] run_external_periodic_tasks = True {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] san_hosts = [] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] scst_target_driver = iscsi {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] scst_target_iqn_name = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] service_down_time = 60 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] snapshot_name_template = snapshot-%s {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] snapshot_same_host = True {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] split_loggers = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] ssh_hosts_key_file = /opt/stack/data/cinder/ssh_known_hosts {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] state_path = /opt/stack/data/cinder {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] storage_availability_zone = nova {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] storage_protocol = iSCSI {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] strict_ssh_host_key_policy = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] syslog_log_facility = LOG_USER {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] target_helper = lioadm {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] target_ip_address = 10.0.0.210 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] target_port = 3260 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] target_protocol = iscsi {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] target_secondary_ip_addresses = [] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] trace_flags = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] transport_url = **** {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] until_refresh = 0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] use_chap_auth = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] use_default_quota_class = True {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] use_eventlog = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] use_journal = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] use_json = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] use_multipath_for_image_xfer = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] use_stderr = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] use_syslog = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] verify_glance_signatures = enabled {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] volume_api_class = cinder.volume.api.API {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] volume_backend_name = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] volume_clear = zero {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] volume_clear_ionice = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] volume_clear_size = 0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] volume_copy_bps_limit = 0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] volume_dd_blocksize = 1M {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] volume_name_template = volume-%s {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] volume_service_inithost_offload = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] volume_usage_audit_period = month {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] watch_log_file = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] zoning_mode = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_concurrency.disable_process_locking = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.admin_password = **** {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.admin_token = **** {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.admin_user = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.auth_admin_prefix = {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.auth_port = 35357 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.auth_protocol = https {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.auth_section = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.auth_type = password {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.auth_uri = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.auth_version = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.cache = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.certfile = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.identity_uri = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.include_service_catalog = True {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.insecure = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.interface = public {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.keyfile = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.region_name = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.service_type = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.backend = dogpile.cache.null {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.backend_argument = **** {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.config_prefix = cache.oslo {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.dead_timeout = 60.0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.debug_cache_backend = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.enable_retry_client = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.enable_socket_keepalive = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.enabled = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.expiration_time = 600 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.hashclient_retry_attempts = 2 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.hashclient_retry_delay = 1.0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.memcache_dead_retry = 300 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.memcache_password = {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.memcache_pool_maxsize = 10 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.memcache_sasl_enabled = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.memcache_socket_timeout = 1.0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.memcache_username = {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.proxies = [] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.retry_attempts = 2 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.retry_delay = 0.0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.socket_keepalive_count = 1 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.socket_keepalive_idle = 1 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.socket_keepalive_interval = 1 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.tls_allowed_ciphers = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.tls_cafile = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.tls_certfile = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.tls_enabled = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cache.tls_keyfile = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] coordination.backend_url = etcd3+http://10.0.0.210:2379 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.backend = sqlalchemy {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.connection = **** {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.connection_debug = 0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.connection_parameters = {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.connection_recycle_time = 3600 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.connection_trace = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.db_inc_retry_interval = True {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.db_max_retries = 20 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.db_max_retry_interval = 10 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.db_retry_interval = 1 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.max_overflow = 50 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.max_pool_size = 5 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.max_retries = 10 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.mysql_enable_ndb = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.mysql_wsrep_sync_wait = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.pool_timeout = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.retry_interval = 10 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.slave_connection = **** {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.sqlite_synchronous = True {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] database.use_db_reconnect = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_policy.enforce_new_defaults = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_policy.enforce_scope = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_policy.policy_default_rule = default {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_policy.policy_file = policy.yaml {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] profiler.connection_string = messaging:// {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] profiler.enabled = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] profiler.es_doc_type = notification {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] profiler.es_scroll_size = 10000 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] profiler.es_scroll_time = 2m {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] profiler.filter_error_trace = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] profiler.hmac_keys = SECRET_KEY {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] profiler.sentinel_service_name = mymaster {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] profiler.socket_timeout = 0.1 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] profiler.trace_sqlalchemy = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] privsep_osbrick.capabilities = [21] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] privsep_osbrick.group = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] privsep_osbrick.helper_command = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] privsep_osbrick.user = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cinder_sys_admin.group = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cinder_sys_admin.helper_command = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cinder_sys_admin.thread_pool_size = 12 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] cinder_sys_admin.user = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] service_user.auth_section = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] service_user.auth_type = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] service_user.cafile = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] service_user.certfile = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] service_user.collect_timing = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] service_user.insecure = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] service_user.keyfile = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] service_user.send_service_user_token = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] service_user.split_loggers = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] service_user.timeout = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.backend_availability_zone = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.chap_password = **** {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.chap_username = {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.driver_client_cert = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.driver_client_cert_key = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.driver_data_namespace = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.driver_use_ssl = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.extra_capabilities = {} {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.filter_function = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.goodness_function = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.iscsi_iotype = fileio {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.iscsi_target_flags = {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.iscsi_write_cache = on {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.iser_helper = tgtadm {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.iser_ip_address = 10.0.0.210 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.iser_port = 3260 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.num_shell_tries = 3 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.replication_device = **** {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.report_discard_supported = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.reserved_percentage = 0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.san_api_port = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.san_clustername = {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.san_ip = {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.san_is_local = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.san_login = admin {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.san_password = **** {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.san_private_key = {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.san_ssh_port = 22 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.san_thin_provision = True {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.ssh_conn_timeout = 30 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.ssh_max_pool_conn = 5 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.ssh_min_pool_conn = 1 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.target_helper = tgtadm {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.target_ip_address = 10.0.0.210 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.target_port = 3260 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.target_protocol = iscsi {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.trace_flags = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.unique_fqdn_network = True {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.use_chap_auth = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.volume_backend_name = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.volume_clear = zero {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.volume_clear_ionice = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.volume_clear_size = 0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_reports.file_event_handler = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_reports.log_dir = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.backend_availability_zone = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.backend_host = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.backend_native_threads_pool_size = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.backup_use_temp_snapshot = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.chap_password = **** {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.chap_username = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.chiscsi_conf = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.driver_client_cert = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.driver_client_cert_key = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.driver_data_namespace = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.driver_ssl_cert_path = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.driver_ssl_cert_verify = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.driver_use_ssl = True {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.enable_unsupported_driver = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.enforce_multipath_for_image_xfer = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.extra_capabilities = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.filter_function = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.goodness_function = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.iet_conf = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.image_upload_use_cinder_backend = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.image_upload_use_internal_tenant = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.image_volume_cache_enabled = True {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.image_volume_cache_max_count = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.image_volume_cache_max_size_gb = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.iscsi_iotype = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.iscsi_target_flags = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.iscsi_write_cache = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.iser_helper = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.iser_ip_address = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.iser_port = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.iser_target_prefix = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.max_over_subscription_ratio = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.num_iser_scan_tries = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.num_shell_tries = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.num_volume_device_scan_tries = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.nvmeof_conn_info_version = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.nvmet_ns_id = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.nvmet_port_id = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.replication_device = **** {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.report_discard_supported = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.reserved_percentage = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.scst_target_driver = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.scst_target_iqn_name = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.storage_protocol = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.suppress_requests_ssl_warnings = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.target_helper = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.target_ip_address = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.target_port = 3260 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.target_prefix = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.target_protocol = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.target_secondary_ip_addresses = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.trace_flags = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.unique_fqdn_network = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.use_chap_auth = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.use_multipath_for_image_xfer = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.volume_backend_name = joviandss-2 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.volume_clear = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.volume_clear_ionice = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.volume_clear_size = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.volume_copy_blkio_cgroup_name = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.volume_copy_bps_limit = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.volume_dd_blocksize = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.volume_driver = cinder.volume.drivers.open_e.iscsi.JovianISCSIDriver {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] joviandss-2.volumes_dir = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.ssl = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_notifications.driver = [] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_notifications.retry = -1 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] key_manager.fixed_key = **** {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican.barbican_api_version = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican.barbican_endpoint = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican.barbican_endpoint_type = public {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican.barbican_region_name = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican.cafile = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican.certfile = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican.collect_timing = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican.insecure = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican.keyfile = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican.number_of_retries = 60 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican.retry_delay = 1 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican.send_service_user_token = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican.split_loggers = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican.timeout = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican.verify_ssl = True {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican.verify_ssl_path = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican_service_user.auth_section = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican_service_user.auth_type = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican_service_user.cafile = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican_service_user.certfile = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican_service_user.collect_timing = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican_service_user.insecure = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican_service_user.keyfile = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican_service_user.split_loggers = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] barbican_service_user.timeout = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] vault.approle_role_id = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] vault.approle_secret_id = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] vault.cafile = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] vault.certfile = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] vault.collect_timing = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] vault.insecure = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] vault.keyfile = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] vault.kv_mountpoint = secret {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] vault.kv_version = 2 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] vault.namespace = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] vault.root_token_id = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] vault.split_loggers = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] vault.ssl_ca_crt_file = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] vault.timeout = None {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] vault.use_ssl = False {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 02:53:58 user cinder-volume[73303]: DEBUG oslo_service.service [None req-ee91c56e-6da2-4ca6-a984-5dff17ecf0c6 None None] ******************************************************************************** {{(pid=73303) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 02:53:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Geting {'code': 200, 'error': None, 'data': {'available': '114304020480', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:53:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] check pool {{(pid=73403) is_pool_exists /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:71}} Apr 14 02:53:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:53:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:54:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Geting {'code': 200, 'error': None, 'data': {'available': '114304020480', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:54:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:54:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:54:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:54:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:54:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Geting {'code': 200, 'error': None, 'data': {'available': '114304020480', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:54:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:54:00 user cinder-volume[73403]: INFO cinder.volume.driver [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Driver hasn't implemented _init_vendor_properties() Apr 14 02:54:00 user cinder-volume[73403]: DEBUG cinder.volume.driver [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Initialized capabilities list: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73403) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:832}} Apr 14 02:54:00 user cinder-volume[73403]: DEBUG oslo_db.sqlalchemy.engines [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73403) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 02:54:00 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writer thread running {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 02:54:00 user cinder-volume[73403]: DEBUG cinder.db.sqlalchemy.api [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Building query based on filter {{(pid=73403) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3885}} Apr 14 02:54:00 user cinder-volume[73403]: DEBUG cinder.image.image_utils [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73403) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1146}} Apr 14 02:54:00 user cinder-volume[73403]: INFO cinder.keymgr.migration [None req-e6e4690a-13f8-41af-8b62-b1ad17e8e1e9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 14 02:54:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:54:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:54:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:54:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:54:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Geting {'code': 200, 'error': None, 'data': {'available': '114304020480', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:54:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:54:01 user cinder-volume[73403]: DEBUG cinder.manager [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:54:01 user cinder-volume[73403]: INFO cinder.volume.manager [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Driver initialization completed successfully. Apr 14 02:54:01 user cinder-volume[73403]: INFO cinder.manager [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Initiating service 2 cleanup Apr 14 02:54:01 user cinder-volume[73403]: INFO cinder.manager [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Service 2 cleanup completed. Apr 14 02:54:01 user cinder-volume[73403]: DEBUG cinder.service [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Creating RPC server for service cinder-volume {{(pid=73403) start /opt/stack/cinder/cinder/service.py:238}} Apr 14 02:54:01 user cinder-volume[73403]: DEBUG cinder.service [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73403) start /opt/stack/cinder/cinder/service.py:244}} Apr 14 02:54:01 user cinder-volume[73403]: INFO cinder.volume.manager [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Initializing RPC dependent components of volume driver JovianISCSIDriver (1.0.2) Apr 14 02:54:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:54:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:54:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:54:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:54:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Geting {'code': 200, 'error': None, 'data': {'available': '114304020480', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:54:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:54:02 user cinder-volume[73403]: INFO cinder.volume.manager [None req-6b592b50-5dc6-4b47-b12d-c8edf436796f None None] Driver post RPC initialization completed successfully. Apr 14 02:54:08 user cinder-volume[73303]: DEBUG dbcounter [-] [73303] Writing DB stats cinder:SELECT=16,cinder:INSERT=1 {{(pid=73303) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:54:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=5 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:54:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=24,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:54:22 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:54:42 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:54:52 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:55:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:55:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:55:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:55:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:55:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:55:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114304020480', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:55:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:55:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:55:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:55:22 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:55:42 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:56:02 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=1,cinder:SELECT=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:56:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:56:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:56:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:56:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:56:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:56:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114304020480', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:56:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:56:03 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:56:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:56:52 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:56:52 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:57:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:57:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:57:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:57:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114304020480', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:57:03 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:57:22 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:57:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Flow 'volume_create_manager' (86274437-f43a-4ecc-9366-beb2efccb823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45ce6cd-dc4c-4449-bfe8-f49fe984ab29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45ce6cd-dc4c-4449-bfe8-f49fe984ab29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1133359536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1c3b6176-90dc-4f51-b393-442f39772db7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02607d4950bf47f2b3c36169b8d9f910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:57:35Z,use_quota=True,user_id='804fe97e7307409c8417c65a581b6354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e8d6ca-e35d-4e38-80de-88577fa6be4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e8d6ca-e35d-4e38-80de-88577fa6be4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1799e90-c769-46e7-8a2e-644317a3fa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1799e90-c769-46e7-8a2e-644317a3fa07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c3b6176-90dc-4f51-b393-442f39772db7', 'volume_name': 'volume-1c3b6176-90dc-4f51-b393-442f39772db7', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0a0cfa-2149-48db-8942-0926b88edad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0a0cfa-2149-48db-8942-0926b88edad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0e1b4d-51f0-4ce4-b985-55170830b0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:35 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Volume 1c3b6176-90dc-4f51-b393-442f39772db7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c3b6176-90dc-4f51-b393-442f39772db7', 'volume_size': 1} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] creating volume v_1c3b6176-90dc-4f51-b393-442f39772db7. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] create volume {'name': 'v_1c3b6176-90dc-4f51-b393-442f39772db7', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Flow 'volume_create_manager' (ac74300d-a024-408a-bb19-5bfadef857c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8e8da6-8405-4cd9-8614-a289dde39e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8e8da6-8405-4cd9-8614-a289dde39e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1984916011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4466f12b-7d3e-42e0-9b51-daf7405408bc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='09a7a892d1cf42f0bb80ec6597a38f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:57:35Z,use_quota=True,user_id='d080bf0706234c1fb084015921fad1fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f145936d-5014-4acf-886c-e81e655f90a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f145936d-5014-4acf-886c-e81e655f90a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46682bf9-9749-469e-af0f-26e6ce8a5a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46682bf9-9749-469e-af0f-26e6ce8a5a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4466f12b-7d3e-42e0-9b51-daf7405408bc', 'volume_name': 'volume-4466f12b-7d3e-42e0-9b51-daf7405408bc', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c6c83c-6a21-424c-906d-fff56f405d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c6c83c-6a21-424c-906d-fff56f405d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e14cba-0861-4262-aa8b-6941d3554667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:35 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Volume 4466f12b-7d3e-42e0-9b51-daf7405408bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4466f12b-7d3e-42e0-9b51-daf7405408bc', 'volume_size': 1} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] creating volume v_4466f12b-7d3e-42e0-9b51-daf7405408bc. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] create volume {'name': 'v_4466f12b-7d3e-42e0-9b51-daf7405408bc', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Flow 'volume_create_manager' (9332baba-a5ba-4f42-923c-59dddc261f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca6c676-e1dd-4865-b044-afaa4e109abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca6c676-e1dd-4865-b044-afaa4e109abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-854961944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=25c5361d-3ebe-4ab7-a6ff-857245bed602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb86fd9df08a4b1c805d5a73291c003c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:57:36Z,use_quota=True,user_id='0c2ba1fb92fd4c739939c03115d3affa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af6eb07-c350-4808-b5be-9effdac5c4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af6eb07-c350-4808-b5be-9effdac5c4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5afc5735-702b-4a1a-9911-f8dd4ad2556f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5afc5735-702b-4a1a-9911-f8dd4ad2556f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25c5361d-3ebe-4ab7-a6ff-857245bed602', 'volume_name': 'volume-25c5361d-3ebe-4ab7-a6ff-857245bed602', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06bd7ef-cd71-4569-b4e3-c724d7edd47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06bd7ef-cd71-4569-b4e3-c724d7edd47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b53ac4f-53ae-466e-acc7-f0eab3783281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:36 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Volume 25c5361d-3ebe-4ab7-a6ff-857245bed602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25c5361d-3ebe-4ab7-a6ff-857245bed602', 'volume_size': 1} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] creating volume v_25c5361d-3ebe-4ab7-a6ff-857245bed602. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] create volume {'name': 'v_25c5361d-3ebe-4ab7-a6ff-857245bed602', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Flow 'volume_create_manager' (6d56c8cc-fc2d-49c3-a717-6f502d8ea6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b431d119-faa6-4c7a-ba7a-4f83372366c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b431d119-faa6-4c7a-ba7a-4f83372366c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-703010538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d6d9aff9-c2f2-4437-9c1a-eda86897fc02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26fd9597777c4396b47df64a3d44f50f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:57:36Z,use_quota=True,user_id='87d28b439a5640bfa7d8911e6205db65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f9330b9-7e26-4772-bda0-6b79bcbea1c5),volume_type_id=3f9330b9-7e26-4772-bda0-6b79bcbea1c5)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f996a2-b6d6-4341-8193-8df343e811ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f996a2-b6d6-4341-8193-8df343e811ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad37ae5-c758-4abb-89d7-661d83327d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad37ae5-c758-4abb-89d7-661d83327d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6d9aff9-c2f2-4437-9c1a-eda86897fc02', 'volume_name': 'volume-d6d9aff9-c2f2-4437-9c1a-eda86897fc02', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053701c0-2a27-40ca-ac6a-aada167ddcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053701c0-2a27-40ca-ac6a-aada167ddcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbae9406-61bf-4f79-b8ff-631cab80ab76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:36 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Volume d6d9aff9-c2f2-4437-9c1a-eda86897fc02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6d9aff9-c2f2-4437-9c1a-eda86897fc02', 'volume_size': 1} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] creating volume v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] create volume {'name': 'v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_1c3b6176-90dc-4f51-b393-442f39772db7', 'is_clone': False, 'name': 'v_1c3b6176-90dc-4f51-b393-442f39772db7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0e1b4d-51f0-4ce4-b985-55170830b0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c3b6176-90dc-4f51-b393-442f39772db7', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ead263-ecaa-4f20-9d52-4ca1597f65c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:36 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Volume volume-1c3b6176-90dc-4f51-b393-442f39772db7 (1c3b6176-90dc-4f51-b393-442f39772db7): created successfully Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ead263-ecaa-4f20-9d52-4ca1597f65c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Flow 'volume_create_manager' (86274437-f43a-4ecc-9366-beb2efccb823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_4466f12b-7d3e-42e0-9b51-daf7405408bc', 'is_clone': False, 'name': 'v_4466f12b-7d3e-42e0-9b51-daf7405408bc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:36 user cinder-volume[73403]: INFO cinder.volume.manager [None req-d54d8570-170d-4508-89d1-32a91854af72 tempest-VolumesTestJSON-1140083610 None] Created volume successfully. Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e14cba-0861-4262-aa8b-6941d3554667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4466f12b-7d3e-42e0-9b51-daf7405408bc', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6c7434-cfd4-4058-a0c7-25618ebdca6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:36 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Volume volume-4466f12b-7d3e-42e0-9b51-daf7405408bc (4466f12b-7d3e-42e0-9b51-daf7405408bc): created successfully Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6c7434-cfd4-4058-a0c7-25618ebdca6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Flow 'volume_create_manager' (ac74300d-a024-408a-bb19-5bfadef857c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:57:36 user cinder-volume[73403]: INFO cinder.volume.manager [req-1d09e8fe-8f2f-4712-aad1-7c6deda31fad req-e5f147e9-844a-41c5-af0c-dedee314313f tempest-VolumesGetTestJSON-1380130811 None] Created volume successfully. Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Flow 'volume_create_manager' (1f181e92-a945-4afc-9090-ec467b9c23d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80e9eca-555c-4908-86e9-d5319857b2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80e9eca-555c-4908-86e9-d5319857b2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1923468648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e7e3ab44-9200-4594-9200-77efe0a8a5d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e80383b1e534bd18b3d2b05f07eda02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:57:37Z,use_quota=True,user_id='be0bdf8dfd8a41fcb6757d1c2d1eadeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbcc9a9-b272-4b05-8012-c14c40239601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbcc9a9-b272-4b05-8012-c14c40239601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7b62fd-2460-427a-8a3e-379b7984ddfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7b62fd-2460-427a-8a3e-379b7984ddfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7e3ab44-9200-4594-9200-77efe0a8a5d7', 'volume_name': 'volume-e7e3ab44-9200-4594-9200-77efe0a8a5d7', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479f568b-1649-4b9c-8489-da5cfa556d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479f568b-1649-4b9c-8489-da5cfa556d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4bdaa90-3595-4246-8d5c-5c0cb16b869e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:36 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Volume e7e3ab44-9200-4594-9200-77efe0a8a5d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7e3ab44-9200-4594-9200-77efe0a8a5d7', 'volume_size': 1} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] creating volume v_e7e3ab44-9200-4594-9200-77efe0a8a5d7. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] create volume {'name': 'v_e7e3ab44-9200-4594-9200-77efe0a8a5d7', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.coordination [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Acquiring lock "cinder-4466f12b-7d3e-42e0-9b51-daf7405408bc-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.coordination [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Lock "cinder-4466f12b-7d3e-42e0-9b51-daf7405408bc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_25c5361d-3ebe-4ab7-a6ff-857245bed602', 'is_clone': False, 'name': 'v_25c5361d-3ebe-4ab7-a6ff-857245bed602'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b53ac4f-53ae-466e-acc7-f0eab3783281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25c5361d-3ebe-4ab7-a6ff-857245bed602', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8feadaa5-d126-4246-8117-5d9fbfbbe442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:37 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Volume volume-25c5361d-3ebe-4ab7-a6ff-857245bed602 (25c5361d-3ebe-4ab7-a6ff-857245bed602): created successfully Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8feadaa5-d126-4246-8117-5d9fbfbbe442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Flow 'volume_create_manager' (9332baba-a5ba-4f42-923c-59dddc261f7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:57:37 user cinder-volume[73403]: INFO cinder.volume.manager [req-f13251ee-160d-434d-8fdb-0b5b76e6d803 req-c901b503-719f-440c-8fb6-d9223f01b3a2 tempest-VolumesSnapshotsTestJSON-1239932062 None] Created volume successfully. Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] remove_export for volume: 4466f12b-7d3e-42e0-9b51-daf7405408bc. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1984916011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4466f12b-7d3e-42e0-9b51-daf7405408bc,launched_at=2023-04-14T02:57:37Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='09a7a892d1cf42f0bb80ec6597a38f29',provider_auth='CHAP GraNoPwH PkcmGrpZHetafC',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4466f12b-7d3e-42e0-9b51-daf7405408bc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:57:35Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:57:37Z,updated_at=2023-04-14T02:57:37Z,use_quota=True,user_id='d080bf0706234c1fb084015921fad1fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:4466f12b-7d3e-42e0-9b51-daf7405408bc. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] detach volume v_4466f12b-7d3e-42e0-9b51-daf7405408bc from target iqn.2010-10.org.openstack:4466f12b-7d3e-42e0-9b51-daf7405408bc {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4466f12b-7d3e-42e0-9b51-daf7405408bc/luns/v_4466f12b-7d3e-42e0-9b51-daf7405408bc {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4466f12b-7d3e-42e0-9b51-daf7405408bc/luns/v_4466f12b-7d3e-42e0-9b51-daf7405408bc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4466f12b-7d3e-42e0-9b51-daf7405408bc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4466f12b-7d3e-42e0-9b51-daf7405408bc/luns/v_4466f12b-7d3e-42e0-9b51-daf7405408bc'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4466f12b-7d3e-42e0-9b51-daf7405408bc/luns/v_4466f12b-7d3e-42e0-9b51-daf7405408bc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] failed to remove resource iqn.2010-10.org.openstack:4466f12b-7d3e-42e0-9b51-daf7405408bc because of JDSS resource v_4466f12b-7d3e-42e0-9b51-daf7405408bc DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] delete target: iqn.2010-10.org.openstack:4466f12b-7d3e-42e0-9b51-daf7405408bc {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] delete target iqn.2010-10.org.openstack:4466f12b-7d3e-42e0-9b51-daf7405408bc {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4466f12b-7d3e-42e0-9b51-daf7405408bc {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4466f12b-7d3e-42e0-9b51-daf7405408bc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4466f12b-7d3e-42e0-9b51-daf7405408bc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4466f12b-7d3e-42e0-9b51-daf7405408bc'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4466f12b-7d3e-42e0-9b51-daf7405408bc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] failed to remove resource iqn.2010-10.org.openstack:4466f12b-7d3e-42e0-9b51-daf7405408bc because of JDSS resource iqn.2010-10.org.openstack:4466f12b-7d3e-42e0-9b51-daf7405408bc DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] deleating volume v_4466f12b-7d3e-42e0-9b51-daf7405408bc {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] get snapshots for volume v_4466f12b-7d3e-42e0-9b51-daf7405408bc {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4466f12b-7d3e-42e0-9b51-daf7405408bc/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4466f12b-7d3e-42e0-9b51-daf7405408bc/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02', 'is_clone': False, 'name': 'v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbae9406-61bf-4f79-b8ff-631cab80ab76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6d9aff9-c2f2-4437-9c1a-eda86897fc02', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b50a03-ccef-4e61-85e5-bcbd4b105cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:37 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Volume volume-d6d9aff9-c2f2-4437-9c1a-eda86897fc02 (d6d9aff9-c2f2-4437-9c1a-eda86897fc02): created successfully Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b50a03-ccef-4e61-85e5-bcbd4b105cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Flow 'volume_create_manager' (6d56c8cc-fc2d-49c3-a717-6f502d8ea6a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:57:37 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8d5ac0c3-6a7f-4d9c-9e1c-8278790e1291 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Created volume successfully. Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e7e3ab44-9200-4594-9200-77efe0a8a5d7', 'is_clone': False, 'name': 'v_e7e3ab44-9200-4594-9200-77efe0a8a5d7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4bdaa90-3595-4246-8d5c-5c0cb16b869e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7e3ab44-9200-4594-9200-77efe0a8a5d7', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fb9f93-f13e-4a41-b223-fa87fcae562f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:37 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Volume volume-e7e3ab44-9200-4594-9200-77efe0a8a5d7 (e7e3ab44-9200-4594-9200-77efe0a8a5d7): created successfully Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fb9f93-f13e-4a41-b223-fa87fcae562f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Flow 'volume_create_manager' (1f181e92-a945-4afc-9090-ec467b9c23d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:57:37 user cinder-volume[73403]: INFO cinder.volume.manager [None req-4fd7c601-ab41-4b51-ae45-3259493c62ca tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Created volume successfully. Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4466f12b-7d3e-42e0-9b51-daf7405408bc/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] get volume v_4466f12b-7d3e-42e0-9b51-daf7405408bc info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4466f12b-7d3e-42e0-9b51-daf7405408bc {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4466f12b-7d3e-42e0-9b51-daf7405408bc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4466f12b-7d3e-42e0-9b51-daf7405408bc', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442465', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112446', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2853138066440338225', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4ed572eba2361f45', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303598592', 'san:volume_id': '4ed572eba2361f454b82c13ffcc8cd4447d82d1d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82677', 'name': 'v_4466f12b-7d3e-42e0-9b51-daf7405408bc', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4466f12b-7d3e-42e0-9b51-daf7405408bc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] delete volume:v_4466f12b-7d3e-42e0-9b51-daf7405408bc recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4466f12b-7d3e-42e0-9b51-daf7405408bc {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4466f12b-7d3e-42e0-9b51-daf7405408bc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:37 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Flow 'volume_create_manager' (d41986e7-af88-4bb5-945a-a03759dd4352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db603bf6-3f84-46fa-bca1-3ca19640a1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db603bf6-3f84-46fa-bca1-3ca19640a1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1512492117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4f3d0e6b-94ce-4891-b038-f00902d4cc5f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02607d4950bf47f2b3c36169b8d9f910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:57:38Z,use_quota=True,user_id='804fe97e7307409c8417c65a581b6354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e23dc466-155b-434f-b2ea-b11f345b5a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e23dc466-155b-434f-b2ea-b11f345b5a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0463ba39-b124-4621-b0f5-7d31dbb7e376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0463ba39-b124-4621-b0f5-7d31dbb7e376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f3d0e6b-94ce-4891-b038-f00902d4cc5f', 'volume_name': 'volume-4f3d0e6b-94ce-4891-b038-f00902d4cc5f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107c51dc-2ade-41b7-8c1e-4780722fbf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107c51dc-2ade-41b7-8c1e-4780722fbf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3d132a-76ca-4e33-b725-0f5f369ba373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:38 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Volume 4f3d0e6b-94ce-4891-b038-f00902d4cc5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f3d0e6b-94ce-4891-b038-f00902d4cc5f', 'volume_size': 1} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] creating volume v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] create volume {'name': 'v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-af4ab977-f715-4c7b-b416-074e82df0dc8 req-c271e563-cfd8-432e-a8cb-c6326468c8f6 tempest-VolumesSnapshotsTestJSON-1239932062 None] create snapshot 092f4172-6dec-4e27-923c-feb6555b1c79 for volume 25c5361d-3ebe-4ab7-a6ff-857245bed602 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-af4ab977-f715-4c7b-b416-074e82df0dc8 req-c271e563-cfd8-432e-a8cb-c6326468c8f6 tempest-VolumesSnapshotsTestJSON-1239932062 None] cloning v_25c5361d-3ebe-4ab7-a6ff-857245bed602 to s_092f4172-6dec-4e27-923c-feb6555b1c79 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-af4ab977-f715-4c7b-b416-074e82df0dc8 req-c271e563-cfd8-432e-a8cb-c6326468c8f6 tempest-VolumesSnapshotsTestJSON-1239932062 None] create snapshot s_092f4172-6dec-4e27-923c-feb6555b1c79 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af4ab977-f715-4c7b-b416-074e82df0dc8 req-c271e563-cfd8-432e-a8cb-c6326468c8f6 tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_25c5361d-3ebe-4ab7-a6ff-857245bed602/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af4ab977-f715-4c7b-b416-074e82df0dc8 req-c271e563-cfd8-432e-a8cb-c6326468c8f6 tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_25c5361d-3ebe-4ab7-a6ff-857245bed602/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3da99f5a-ec73-485d-b4ff-e50c1860e070 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3da99f5a-ec73-485d-b4ff-e50c1860e070 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da99f5a-ec73-485d-b4ff-e50c1860e070 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da99f5a-ec73-485d-b4ff-e50c1860e070 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f', 'is_clone': False, 'name': 'v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3d132a-76ca-4e33-b725-0f5f369ba373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f3d0e6b-94ce-4891-b038-f00902d4cc5f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e545095-a888-43e6-87be-0d63db637219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:39 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Volume volume-4f3d0e6b-94ce-4891-b038-f00902d4cc5f (4f3d0e6b-94ce-4891-b038-f00902d4cc5f): created successfully Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e545095-a888-43e6-87be-0d63db637219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Flow 'volume_create_manager' (d41986e7-af88-4bb5-945a-a03759dd4352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:57:39 user cinder-volume[73403]: INFO cinder.volume.manager [None req-869965be-c2c8-4650-a290-926953f3eadc tempest-VolumesTestJSON-1140083610 None] Created volume successfully. Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.coordination [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Acquiring lock "cinder-e7e3ab44-9200-4594-9200-77efe0a8a5d7-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af4ab977-f715-4c7b-b416-074e82df0dc8 req-c271e563-cfd8-432e-a8cb-c6326468c8f6 tempest-VolumesSnapshotsTestJSON-1239932062 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_092f4172-6dec-4e27-923c-feb6555b1c79'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_25c5361d-3ebe-4ab7-a6ff-857245bed602/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-af4ab977-f715-4c7b-b416-074e82df0dc8 req-c271e563-cfd8-432e-a8cb-c6326468c8f6 tempest-VolumesSnapshotsTestJSON-1239932062 None] create volume s_092f4172-6dec-4e27-923c-feb6555b1c79 from snapshot s_092f4172-6dec-4e27-923c-feb6555b1c79 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af4ab977-f715-4c7b-b416-074e82df0dc8 req-c271e563-cfd8-432e-a8cb-c6326468c8f6 tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_25c5361d-3ebe-4ab7-a6ff-857245bed602/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af4ab977-f715-4c7b-b416-074e82df0dc8 req-c271e563-cfd8-432e-a8cb-c6326468c8f6 tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_25c5361d-3ebe-4ab7-a6ff-857245bed602/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.coordination [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Lock "cinder-e7e3ab44-9200-4594-9200-77efe0a8a5d7-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] remove_export for volume: e7e3ab44-9200-4594-9200-77efe0a8a5d7. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1923468648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e7e3ab44-9200-4594-9200-77efe0a8a5d7,launched_at=2023-04-14T02:57:38Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='7e80383b1e534bd18b3d2b05f07eda02',provider_auth='CHAP QyDXmtYi oZ8dwh0TtI1bky',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7e3ab44-9200-4594-9200-77efe0a8a5d7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:57:37Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:57:39Z,updated_at=2023-04-14T02:57:40Z,use_quota=True,user_id='be0bdf8dfd8a41fcb6757d1c2d1eadeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:e7e3ab44-9200-4594-9200-77efe0a8a5d7. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] detach volume v_e7e3ab44-9200-4594-9200-77efe0a8a5d7 from target iqn.2010-10.org.openstack:e7e3ab44-9200-4594-9200-77efe0a8a5d7 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e7e3ab44-9200-4594-9200-77efe0a8a5d7/luns/v_e7e3ab44-9200-4594-9200-77efe0a8a5d7 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e7e3ab44-9200-4594-9200-77efe0a8a5d7/luns/v_e7e3ab44-9200-4594-9200-77efe0a8a5d7 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e7e3ab44-9200-4594-9200-77efe0a8a5d7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e7e3ab44-9200-4594-9200-77efe0a8a5d7/luns/v_e7e3ab44-9200-4594-9200-77efe0a8a5d7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e7e3ab44-9200-4594-9200-77efe0a8a5d7/luns/v_e7e3ab44-9200-4594-9200-77efe0a8a5d7 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] failed to remove resource iqn.2010-10.org.openstack:e7e3ab44-9200-4594-9200-77efe0a8a5d7 because of JDSS resource v_e7e3ab44-9200-4594-9200-77efe0a8a5d7 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] delete target: iqn.2010-10.org.openstack:e7e3ab44-9200-4594-9200-77efe0a8a5d7 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] delete target iqn.2010-10.org.openstack:e7e3ab44-9200-4594-9200-77efe0a8a5d7 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e7e3ab44-9200-4594-9200-77efe0a8a5d7 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e7e3ab44-9200-4594-9200-77efe0a8a5d7 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e7e3ab44-9200-4594-9200-77efe0a8a5d7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e7e3ab44-9200-4594-9200-77efe0a8a5d7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e7e3ab44-9200-4594-9200-77efe0a8a5d7 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] failed to remove resource iqn.2010-10.org.openstack:e7e3ab44-9200-4594-9200-77efe0a8a5d7 because of JDSS resource iqn.2010-10.org.openstack:e7e3ab44-9200-4594-9200-77efe0a8a5d7 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] deleating volume v_e7e3ab44-9200-4594-9200-77efe0a8a5d7 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] get snapshots for volume v_e7e3ab44-9200-4594-9200-77efe0a8a5d7 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e7e3ab44-9200-4594-9200-77efe0a8a5d7/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e7e3ab44-9200-4594-9200-77efe0a8a5d7/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:39 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Acquiring lock "cinder-d6d9aff9-c2f2-4437-9c1a-eda86897fc02-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Lock "cinder-d6d9aff9-c2f2-4437-9c1a-eda86897fc02-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] remove_export for volume: d6d9aff9-c2f2-4437-9c1a-eda86897fc02. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-703010538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d6d9aff9-c2f2-4437-9c1a-eda86897fc02,launched_at=2023-04-14T02:57:37Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='26fd9597777c4396b47df64a3d44f50f',provider_auth='CHAP cloTXDhi LdK6WaiTFbnyhE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d9aff9-c2f2-4437-9c1a-eda86897fc02 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:57:36Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:57:40Z,updated_at=2023-04-14T02:57:40Z,use_quota=True,user_id='87d28b439a5640bfa7d8911e6205db65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6ae917f-e918-4935-b6dd-dcd37fe3d64e),volume_type_id=b6ae917f-e918-4935-b6dd-dcd37fe3d64e) from target:iqn.2010-10.org.openstack:d6d9aff9-c2f2-4437-9c1a-eda86897fc02. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] detach volume v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02 from target iqn.2010-10.org.openstack:d6d9aff9-c2f2-4437-9c1a-eda86897fc02 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6d9aff9-c2f2-4437-9c1a-eda86897fc02/luns/v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6d9aff9-c2f2-4437-9c1a-eda86897fc02/luns/v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d6d9aff9-c2f2-4437-9c1a-eda86897fc02 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6d9aff9-c2f2-4437-9c1a-eda86897fc02/luns/v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6d9aff9-c2f2-4437-9c1a-eda86897fc02/luns/v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] failed to remove resource iqn.2010-10.org.openstack:d6d9aff9-c2f2-4437-9c1a-eda86897fc02 because of JDSS resource v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] delete target: iqn.2010-10.org.openstack:d6d9aff9-c2f2-4437-9c1a-eda86897fc02 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] delete target iqn.2010-10.org.openstack:d6d9aff9-c2f2-4437-9c1a-eda86897fc02 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6d9aff9-c2f2-4437-9c1a-eda86897fc02 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6d9aff9-c2f2-4437-9c1a-eda86897fc02 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d6d9aff9-c2f2-4437-9c1a-eda86897fc02 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6d9aff9-c2f2-4437-9c1a-eda86897fc02'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d6d9aff9-c2f2-4437-9c1a-eda86897fc02 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] failed to remove resource iqn.2010-10.org.openstack:d6d9aff9-c2f2-4437-9c1a-eda86897fc02 because of JDSS resource iqn.2010-10.org.openstack:d6d9aff9-c2f2-4437-9c1a-eda86897fc02 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] deleating volume v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] get snapshots for volume v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e7e3ab44-9200-4594-9200-77efe0a8a5d7/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] get volume v_e7e3ab44-9200-4594-9200-77efe0a8a5d7 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e7e3ab44-9200-4594-9200-77efe0a8a5d7 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e7e3ab44-9200-4594-9200-77efe0a8a5d7 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e7e3ab44-9200-4594-9200-77efe0a8a5d7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442466', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112457', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '522724295508778956', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'eaed6dcea3966929', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303598592', 'san:volume_id': 'eaed6dcea39669293d3b516fa5fbc97aefc03546', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85007', 'name': 'v_e7e3ab44-9200-4594-9200-77efe0a8a5d7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e7e3ab44-9200-4594-9200-77efe0a8a5d7 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] delete volume:v_e7e3ab44-9200-4594-9200-77efe0a8a5d7 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e7e3ab44-9200-4594-9200-77efe0a8a5d7 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e7e3ab44-9200-4594-9200-77efe0a8a5d7 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3da99f5a-ec73-485d-b4ff-e50c1860e070 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303598592', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3da99f5a-ec73-485d-b4ff-e50c1860e070 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.manager [None req-3da99f5a-ec73-485d-b4ff-e50c1860e070 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:57:40 user cinder-volume[73403]: INFO cinder.volume.manager [None req-3da99f5a-ec73-485d-b4ff-e50c1860e070 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Retype volume completed successfully. Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] get volume v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Flow 'volume_create_manager' (57206b83-2ce5-468d-8e0e-8ee47fc529c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8136006-bb2d-4126-af58-20e792ef0b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442466', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112454', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10395962839433018376', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9d4ebdb7ad17aff9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303586304', 'san:volume_id': '9d4ebdb7ad17aff918e936b2ce274b0a813f9965', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84999', 'name': 'v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] delete volume:v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8136006-bb2d-4126-af58-20e792ef0b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1798075621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=cbb70dad-3e25-4c25-9ee2-6372362ef157,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02607d4950bf47f2b3c36169b8d9f910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:57:41Z,use_quota=True,user_id='804fe97e7307409c8417c65a581b6354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d44dda0-4b19-419f-b7ab-1ef7a2a237be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d44dda0-4b19-419f-b7ab-1ef7a2a237be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e572418a-cb59-4308-b585-d22269bbc836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e572418a-cb59-4308-b585-d22269bbc836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb70dad-3e25-4c25-9ee2-6372362ef157', 'volume_name': 'volume-cbb70dad-3e25-4c25-9ee2-6372362ef157', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fef5ed7-ae1b-4d71-bd00-9427d54811d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fef5ed7-ae1b-4d71-bd00-9427d54811d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18c9632-0dc9-47ac-b337-a52d54c4b7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:40 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Volume cbb70dad-3e25-4c25-9ee2-6372362ef157: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb70dad-3e25-4c25-9ee2-6372362ef157', 'volume_size': 1} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] creating volume v_cbb70dad-3e25-4c25-9ee2-6372362ef157. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] create volume {'name': 'v_cbb70dad-3e25-4c25-9ee2-6372362ef157', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af4ab977-f715-4c7b-b416-074e82df0dc8 req-c271e563-cfd8-432e-a8cb-c6326468c8f6 tempest-VolumesSnapshotsTestJSON-1239932062 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_25c5361d-3ebe-4ab7-a6ff-857245bed602@s_092f4172-6dec-4e27-923c-feb6555b1c79', 'is_clone': True, 'full_name': 'Pool-0/s_092f4172-6dec-4e27-923c-feb6555b1c79', 'name': 's_092f4172-6dec-4e27-923c-feb6555b1c79'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_25c5361d-3ebe-4ab7-a6ff-857245bed602/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af4ab977-f715-4c7b-b416-074e82df0dc8 req-c271e563-cfd8-432e-a8cb-c6326468c8f6 tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_092f4172-6dec-4e27-923c-feb6555b1c79/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af4ab977-f715-4c7b-b416-074e82df0dc8 req-c271e563-cfd8-432e-a8cb-c6326468c8f6 tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_092f4172-6dec-4e27-923c-feb6555b1c79/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_cbb70dad-3e25-4c25-9ee2-6372362ef157', 'is_clone': False, 'name': 'v_cbb70dad-3e25-4c25-9ee2-6372362ef157'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18c9632-0dc9-47ac-b337-a52d54c4b7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb70dad-3e25-4c25-9ee2-6372362ef157', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b96858-5ad8-4c5e-99bd-7f1626f59007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:42 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Volume volume-cbb70dad-3e25-4c25-9ee2-6372362ef157 (cbb70dad-3e25-4c25-9ee2-6372362ef157): created successfully Apr 14 02:57:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b96858-5ad8-4c5e-99bd-7f1626f59007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Flow 'volume_create_manager' (57206b83-2ce5-468d-8e0e-8ee47fc529c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:57:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-af4ab977-f715-4c7b-b416-074e82df0dc8 req-c271e563-cfd8-432e-a8cb-c6326468c8f6 tempest-VolumesSnapshotsTestJSON-1239932062 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_092f4172-6dec-4e27-923c-feb6555b1c79/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-af4ab977-f715-4c7b-b416-074e82df0dc8 req-c271e563-cfd8-432e-a8cb-c6326468c8f6 tempest-VolumesSnapshotsTestJSON-1239932062 None] volume s_092f4172-6dec-4e27-923c-feb6555b1c79 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:57:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4466f12b-7d3e-42e0-9b51-daf7405408bc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] volume v_4466f12b-7d3e-42e0-9b51-daf7405408bc deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:57:42 user cinder-volume[73403]: INFO cinder.volume.manager [req-af4ab977-f715-4c7b-b416-074e82df0dc8 req-c271e563-cfd8-432e-a8cb-c6326468c8f6 tempest-VolumesSnapshotsTestJSON-1239932062 None] Create snapshot completed successfully Apr 14 02:57:42 user cinder-volume[73403]: INFO cinder.volume.manager [None req-830f398f-556c-47b9-bf2a-b9f755a57def tempest-VolumesTestJSON-1140083610 None] Created volume successfully. Apr 14 02:57:42 user cinder-volume[73403]: WARNING cinder.quota [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Deprecated: Default quota for resource: volumes_joviandss-2 is set by the default quota flag: quota_volumes_joviandss-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:57:42 user cinder-volume[73403]: WARNING cinder.quota [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Deprecated: Default quota for resource: gigabytes_joviandss-2 is set by the default quota flag: quota_gigabytes_joviandss-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:57:42 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=75,cinder:UPDATE=19,cinder:DELETE=4,cinder:INSERT=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:57:42 user cinder-volume[73403]: DEBUG cinder.quota [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Created reservations ['34c47eda-62ff-459a-83d1-dd313e8764e6', 'bee6daa3-e096-4d0d-831a-11b781e3c060', '651d4cb4-5371-4fbf-8efe-bba53fac8bfc', '15bc73b5-bb76-4681-8466-41630f535dfe'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:57:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:57:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:57:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:42 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=60,cinder:UPDATE=34,cinder:DELETE=4,cinder:INSERT=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:57:42 user cinder-volume[73403]: DEBUG cinder.coordination [req-9aa56817-94fa-4af5-b3f6-0743891a295b req-ee644eba-2b3f-408b-917e-1ec834fe3801 tempest-VolumesSnapshotsTestJSON-1239932062 None] Acquiring lock "cinder-092f4172-6dec-4e27-923c-feb6555b1c79-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:57:42 user cinder-volume[73403]: DEBUG cinder.coordination [req-9aa56817-94fa-4af5-b3f6-0743891a295b req-ee644eba-2b3f-408b-917e-1ec834fe3801 tempest-VolumesSnapshotsTestJSON-1239932062 None] Lock "cinder-092f4172-6dec-4e27-923c-feb6555b1c79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:57:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9aa56817-94fa-4af5-b3f6-0743891a295b req-ee644eba-2b3f-408b-917e-1ec834fe3801 tempest-VolumesSnapshotsTestJSON-1239932062 None] deleating snapshot s_092f4172-6dec-4e27-923c-feb6555b1c79. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:57:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9aa56817-94fa-4af5-b3f6-0743891a295b req-ee644eba-2b3f-408b-917e-1ec834fe3801 tempest-VolumesSnapshotsTestJSON-1239932062 None] get snapshots for volume s_092f4172-6dec-4e27-923c-feb6555b1c79 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:57:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9aa56817-94fa-4af5-b3f6-0743891a295b req-ee644eba-2b3f-408b-917e-1ec834fe3801 tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_092f4172-6dec-4e27-923c-feb6555b1c79/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9aa56817-94fa-4af5-b3f6-0743891a295b req-ee644eba-2b3f-408b-917e-1ec834fe3801 tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_092f4172-6dec-4e27-923c-feb6555b1c79/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303680512', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.manager [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:57:43 user cinder-volume[73403]: INFO cinder.volume.manager [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Deleted volume successfully. Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.coordination [req-03f540d1-e990-4e88-98fe-9855e9c7fc52 req-0c904bc6-d7c9-4096-9922-bc4f0718247c tempest-VolumesGetTestJSON-1380130811 None] Lock "cinder-4466f12b-7d3e-42e0-9b51-daf7405408bc-delete_volume" released by "delete_volume" :: held 6.032s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] volume v_d6d9aff9-c2f2-4437-9c1a-eda86897fc02 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:57:43 user cinder-volume[73403]: WARNING cinder.quota [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:57:43 user cinder-volume[73403]: WARNING cinder.quota [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.quota [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Created reservations ['bb87e564-8926-4a67-8788-8c86535a3a59', '26c37f89-b929-419d-b286-1ddbb2cd2952', '01ad1730-271f-46c3-bfcb-745b37d97a46', '9cd61ce5-f75f-4c30-8c52-b8113d0aeb61'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9aa56817-94fa-4af5-b3f6-0743891a295b req-ee644eba-2b3f-408b-917e-1ec834fe3801 tempest-VolumesSnapshotsTestJSON-1239932062 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_092f4172-6dec-4e27-923c-feb6555b1c79/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9aa56817-94fa-4af5-b3f6-0743891a295b req-ee644eba-2b3f-408b-917e-1ec834fe3801 tempest-VolumesSnapshotsTestJSON-1239932062 None] get volume s_092f4172-6dec-4e27-923c-feb6555b1c79 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9aa56817-94fa-4af5-b3f6-0743891a295b req-ee644eba-2b3f-408b-917e-1ec834fe3801 tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_092f4172-6dec-4e27-923c-feb6555b1c79 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9aa56817-94fa-4af5-b3f6-0743891a295b req-ee644eba-2b3f-408b-917e-1ec834fe3801 tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_092f4172-6dec-4e27-923c-feb6555b1c79 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9aa56817-94fa-4af5-b3f6-0743891a295b req-ee644eba-2b3f-408b-917e-1ec834fe3801 tempest-VolumesSnapshotsTestJSON-1239932062 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_25c5361d-3ebe-4ab7-a6ff-857245bed602@s_092f4172-6dec-4e27-923c-feb6555b1c79', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_092f4172-6dec-4e27-923c-feb6555b1c79', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442469', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112470', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '504510444980134675', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3aaa2a7145d3e4b4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303680512', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84882', 'name': 's_092f4172-6dec-4e27-923c-feb6555b1c79', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_092f4172-6dec-4e27-923c-feb6555b1c79 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9aa56817-94fa-4af5-b3f6-0743891a295b req-ee644eba-2b3f-408b-917e-1ec834fe3801 tempest-VolumesSnapshotsTestJSON-1239932062 None] delete snapshot s_092f4172-6dec-4e27-923c-feb6555b1c79 of volume v_25c5361d-3ebe-4ab7-a6ff-857245bed602 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9aa56817-94fa-4af5-b3f6-0743891a295b req-ee644eba-2b3f-408b-917e-1ec834fe3801 tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_25c5361d-3ebe-4ab7-a6ff-857245bed602/snapshots/s_092f4172-6dec-4e27-923c-feb6555b1c79 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9aa56817-94fa-4af5-b3f6-0743891a295b req-ee644eba-2b3f-408b-917e-1ec834fe3801 tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_25c5361d-3ebe-4ab7-a6ff-857245bed602/snapshots/s_092f4172-6dec-4e27-923c-feb6555b1c79 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Acquiring lock "cinder-cbb70dad-3e25-4c25-9ee2-6372362ef157-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Lock "cinder-cbb70dad-3e25-4c25-9ee2-6372362ef157-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] remove_export for volume: cbb70dad-3e25-4c25-9ee2-6372362ef157. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1798075621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=cbb70dad-3e25-4c25-9ee2-6372362ef157,launched_at=2023-04-14T02:57:42Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02607d4950bf47f2b3c36169b8d9f910',provider_auth='CHAP UsCiuYDz DjAxZqg5sTUfYi',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbb70dad-3e25-4c25-9ee2-6372362ef157 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:57:41Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:57:44Z,updated_at=2023-04-14T02:57:44Z,use_quota=True,user_id='804fe97e7307409c8417c65a581b6354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:cbb70dad-3e25-4c25-9ee2-6372362ef157. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] detach volume v_cbb70dad-3e25-4c25-9ee2-6372362ef157 from target iqn.2010-10.org.openstack:cbb70dad-3e25-4c25-9ee2-6372362ef157 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cbb70dad-3e25-4c25-9ee2-6372362ef157/luns/v_cbb70dad-3e25-4c25-9ee2-6372362ef157 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cbb70dad-3e25-4c25-9ee2-6372362ef157/luns/v_cbb70dad-3e25-4c25-9ee2-6372362ef157 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:cbb70dad-3e25-4c25-9ee2-6372362ef157 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cbb70dad-3e25-4c25-9ee2-6372362ef157/luns/v_cbb70dad-3e25-4c25-9ee2-6372362ef157'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cbb70dad-3e25-4c25-9ee2-6372362ef157/luns/v_cbb70dad-3e25-4c25-9ee2-6372362ef157 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] failed to remove resource iqn.2010-10.org.openstack:cbb70dad-3e25-4c25-9ee2-6372362ef157 because of JDSS resource v_cbb70dad-3e25-4c25-9ee2-6372362ef157 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] delete target: iqn.2010-10.org.openstack:cbb70dad-3e25-4c25-9ee2-6372362ef157 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] delete target iqn.2010-10.org.openstack:cbb70dad-3e25-4c25-9ee2-6372362ef157 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cbb70dad-3e25-4c25-9ee2-6372362ef157 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cbb70dad-3e25-4c25-9ee2-6372362ef157 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:cbb70dad-3e25-4c25-9ee2-6372362ef157 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cbb70dad-3e25-4c25-9ee2-6372362ef157'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cbb70dad-3e25-4c25-9ee2-6372362ef157 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] failed to remove resource iqn.2010-10.org.openstack:cbb70dad-3e25-4c25-9ee2-6372362ef157 because of JDSS resource iqn.2010-10.org.openstack:cbb70dad-3e25-4c25-9ee2-6372362ef157 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] deleating volume v_cbb70dad-3e25-4c25-9ee2-6372362ef157 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] get snapshots for volume v_cbb70dad-3e25-4c25-9ee2-6372362ef157 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cbb70dad-3e25-4c25-9ee2-6372362ef157/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cbb70dad-3e25-4c25-9ee2-6372362ef157/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303655936', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:57:44 user cinder-volume[73403]: DEBUG cinder.manager [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:57:44 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Deleted volume successfully. Apr 14 02:57:44 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8b3e9c3d-d897-4f24-963b-40b5529034b3 tempest-VolumeRetypeWithoutMigrationTest-939094672 None] Lock "cinder-d6d9aff9-c2f2-4437-9c1a-eda86897fc02-delete_volume" released by "delete_volume" :: held 4.279s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:57:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e7e3ab44-9200-4594-9200-77efe0a8a5d7 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] volume v_e7e3ab44-9200-4594-9200-77efe0a8a5d7 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:57:44 user cinder-volume[73403]: DEBUG cinder.quota [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Created reservations ['a425625a-8d90-42ae-b218-7b78c1f28d31', 'd9be1901-75a7-493c-8839-11b15bea10cc', 'e0819154-3ee8-416e-8125-5255571a7228', 'cc8007bd-8584-4c7b-b1d2-7fe98b50a0da'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:57:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:57:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:57:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cbb70dad-3e25-4c25-9ee2-6372362ef157/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] get volume v_cbb70dad-3e25-4c25-9ee2-6372362ef157 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:57:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cbb70dad-3e25-4c25-9ee2-6372362ef157 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cbb70dad-3e25-4c25-9ee2-6372362ef157 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_cbb70dad-3e25-4c25-9ee2-6372362ef157', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442470', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112474', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15046308708304294467', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f97382d3e0b47594', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303655936', 'san:volume_id': 'f97382d3e0b4759484f140f855b4afff699caf89', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83988', 'name': 'v_cbb70dad-3e25-4c25-9ee2-6372362ef157', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cbb70dad-3e25-4c25-9ee2-6372362ef157 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] delete volume:v_cbb70dad-3e25-4c25-9ee2-6372362ef157 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:57:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cbb70dad-3e25-4c25-9ee2-6372362ef157 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cbb70dad-3e25-4c25-9ee2-6372362ef157 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303655936', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:57:45 user cinder-volume[73403]: DEBUG cinder.manager [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:57:45 user cinder-volume[73403]: INFO cinder.volume.manager [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Deleted volume successfully. Apr 14 02:57:45 user cinder-volume[73403]: DEBUG cinder.coordination [None req-0d6201dc-8ed2-4429-b6c9-7e557905874a tempest-VolumeQuotasNegativeTestJSON-1345832510 None] Lock "cinder-e7e3ab44-9200-4594-9200-77efe0a8a5d7-delete_volume" released by "delete_volume" :: held 5.766s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:57:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9aa56817-94fa-4af5-b3f6-0743891a295b req-ee644eba-2b3f-408b-917e-1ec834fe3801 tempest-VolumesSnapshotsTestJSON-1239932062 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_25c5361d-3ebe-4ab7-a6ff-857245bed602/snapshots/s_092f4172-6dec-4e27-923c-feb6555b1c79 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9aa56817-94fa-4af5-b3f6-0743891a295b req-ee644eba-2b3f-408b-917e-1ec834fe3801 tempest-VolumesSnapshotsTestJSON-1239932062 None] snapshot s_092f4172-6dec-4e27-923c-feb6555b1c79 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:57:45 user cinder-volume[73403]: WARNING cinder.quota [req-9aa56817-94fa-4af5-b3f6-0743891a295b req-ee644eba-2b3f-408b-917e-1ec834fe3801 tempest-VolumesSnapshotsTestJSON-1239932062 None] Deprecated: Default quota for resource: snapshots_joviandss-2 is set by the default quota flag: quota_snapshots_joviandss-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:57:45 user cinder-volume[73403]: DEBUG cinder.quota [req-9aa56817-94fa-4af5-b3f6-0743891a295b req-ee644eba-2b3f-408b-917e-1ec834fe3801 tempest-VolumesSnapshotsTestJSON-1239932062 None] Created reservations ['aa641732-9cca-4ed2-89fa-db2e1243a365', 'e949efeb-9723-4229-a6e7-8e08554c1449', '3621eaf7-bcac-443d-a92a-7aaf7ddeab4a', 'e727727c-e861-4e9d-954a-a0c8d9932c2c'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:57:45 user cinder-volume[73403]: INFO cinder.volume.manager [req-9aa56817-94fa-4af5-b3f6-0743891a295b req-ee644eba-2b3f-408b-917e-1ec834fe3801 tempest-VolumesSnapshotsTestJSON-1239932062 None] Delete snapshot completed successfully. Apr 14 02:57:45 user cinder-volume[73403]: DEBUG cinder.coordination [req-9aa56817-94fa-4af5-b3f6-0743891a295b req-ee644eba-2b3f-408b-917e-1ec834fe3801 tempest-VolumesSnapshotsTestJSON-1239932062 None] Lock "cinder-092f4172-6dec-4e27-923c-feb6555b1c79-delete_snapshot" released by "delete_snapshot" :: held 2.511s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.coordination [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Acquiring lock "cinder-25c5361d-3ebe-4ab7-a6ff-857245bed602-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.coordination [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Lock "cinder-25c5361d-3ebe-4ab7-a6ff-857245bed602-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] remove_export for volume: 25c5361d-3ebe-4ab7-a6ff-857245bed602. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-854961944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=25c5361d-3ebe-4ab7-a6ff-857245bed602,launched_at=2023-04-14T02:57:37Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb86fd9df08a4b1c805d5a73291c003c',provider_auth='CHAP PnDUSQjJ 5DCv0xtSEayceW',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c5361d-3ebe-4ab7-a6ff-857245bed602 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:57:36Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:57:46Z,updated_at=2023-04-14T02:57:46Z,use_quota=True,user_id='0c2ba1fb92fd4c739939c03115d3affa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:25c5361d-3ebe-4ab7-a6ff-857245bed602. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] detach volume v_25c5361d-3ebe-4ab7-a6ff-857245bed602 from target iqn.2010-10.org.openstack:25c5361d-3ebe-4ab7-a6ff-857245bed602 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:25c5361d-3ebe-4ab7-a6ff-857245bed602/luns/v_25c5361d-3ebe-4ab7-a6ff-857245bed602 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:25c5361d-3ebe-4ab7-a6ff-857245bed602/luns/v_25c5361d-3ebe-4ab7-a6ff-857245bed602 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:25c5361d-3ebe-4ab7-a6ff-857245bed602 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:25c5361d-3ebe-4ab7-a6ff-857245bed602/luns/v_25c5361d-3ebe-4ab7-a6ff-857245bed602'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:25c5361d-3ebe-4ab7-a6ff-857245bed602/luns/v_25c5361d-3ebe-4ab7-a6ff-857245bed602 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] failed to remove resource iqn.2010-10.org.openstack:25c5361d-3ebe-4ab7-a6ff-857245bed602 because of JDSS resource v_25c5361d-3ebe-4ab7-a6ff-857245bed602 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] delete target: iqn.2010-10.org.openstack:25c5361d-3ebe-4ab7-a6ff-857245bed602 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] delete target iqn.2010-10.org.openstack:25c5361d-3ebe-4ab7-a6ff-857245bed602 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:25c5361d-3ebe-4ab7-a6ff-857245bed602 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:25c5361d-3ebe-4ab7-a6ff-857245bed602 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:25c5361d-3ebe-4ab7-a6ff-857245bed602 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:25c5361d-3ebe-4ab7-a6ff-857245bed602'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:25c5361d-3ebe-4ab7-a6ff-857245bed602 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] failed to remove resource iqn.2010-10.org.openstack:25c5361d-3ebe-4ab7-a6ff-857245bed602 because of JDSS resource iqn.2010-10.org.openstack:25c5361d-3ebe-4ab7-a6ff-857245bed602 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] deleating volume v_25c5361d-3ebe-4ab7-a6ff-857245bed602 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] get snapshots for volume v_25c5361d-3ebe-4ab7-a6ff-857245bed602 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_25c5361d-3ebe-4ab7-a6ff-857245bed602/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_25c5361d-3ebe-4ab7-a6ff-857245bed602/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_25c5361d-3ebe-4ab7-a6ff-857245bed602/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] get volume v_25c5361d-3ebe-4ab7-a6ff-857245bed602 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_25c5361d-3ebe-4ab7-a6ff-857245bed602 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_25c5361d-3ebe-4ab7-a6ff-857245bed602 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_25c5361d-3ebe-4ab7-a6ff-857245bed602', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442465', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112451', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14445503065849897183', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2879816cdba0994c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303762432', 'san:volume_id': '2879816cdba0994ca838f2270475c50dcdc11c88', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82687', 'name': 'v_25c5361d-3ebe-4ab7-a6ff-857245bed602', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_25c5361d-3ebe-4ab7-a6ff-857245bed602 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] delete volume:v_25c5361d-3ebe-4ab7-a6ff-857245bed602 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_25c5361d-3ebe-4ab7-a6ff-857245bed602 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_25c5361d-3ebe-4ab7-a6ff-857245bed602 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cbb70dad-3e25-4c25-9ee2-6372362ef157 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] volume v_cbb70dad-3e25-4c25-9ee2-6372362ef157 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:57:47 user cinder-volume[73403]: DEBUG cinder.quota [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Created reservations ['c07f5262-fb39-417f-a0b0-8c59b57b41d6', 'c75731ad-1b08-4a48-b3d2-141d6426fdf5', 'aa27ff3a-1230-4511-af58-b6f102bc8c66', '035565e9-7cef-4440-ae94-97a5956b2b12'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:57:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:57:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:57:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303762432', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:57:47 user cinder-volume[73403]: DEBUG cinder.manager [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:57:47 user cinder-volume[73403]: INFO cinder.volume.manager [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Deleted volume successfully. Apr 14 02:57:47 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f2a54f09-8d94-4bb2-925b-423cee44b122 tempest-VolumesTestJSON-1140083610 None] Lock "cinder-cbb70dad-3e25-4c25-9ee2-6372362ef157-delete_volume" released by "delete_volume" :: held 4.128s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Acquiring lock "cinder-4f3d0e6b-94ce-4891-b038-f00902d4cc5f-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Lock "cinder-4f3d0e6b-94ce-4891-b038-f00902d4cc5f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] remove_export for volume: 4f3d0e6b-94ce-4891-b038-f00902d4cc5f. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1512492117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4f3d0e6b-94ce-4891-b038-f00902d4cc5f,launched_at=2023-04-14T02:57:39Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02607d4950bf47f2b3c36169b8d9f910',provider_auth='CHAP uNaYAIKT tLMn45ONwCfqru',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3d0e6b-94ce-4891-b038-f00902d4cc5f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:57:38Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:57:48Z,updated_at=2023-04-14T02:57:48Z,use_quota=True,user_id='804fe97e7307409c8417c65a581b6354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:4f3d0e6b-94ce-4891-b038-f00902d4cc5f. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] detach volume v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f from target iqn.2010-10.org.openstack:4f3d0e6b-94ce-4891-b038-f00902d4cc5f {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4f3d0e6b-94ce-4891-b038-f00902d4cc5f/luns/v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4f3d0e6b-94ce-4891-b038-f00902d4cc5f/luns/v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4f3d0e6b-94ce-4891-b038-f00902d4cc5f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4f3d0e6b-94ce-4891-b038-f00902d4cc5f/luns/v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4f3d0e6b-94ce-4891-b038-f00902d4cc5f/luns/v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] failed to remove resource iqn.2010-10.org.openstack:4f3d0e6b-94ce-4891-b038-f00902d4cc5f because of JDSS resource v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] delete target: iqn.2010-10.org.openstack:4f3d0e6b-94ce-4891-b038-f00902d4cc5f {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] delete target iqn.2010-10.org.openstack:4f3d0e6b-94ce-4891-b038-f00902d4cc5f {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4f3d0e6b-94ce-4891-b038-f00902d4cc5f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4f3d0e6b-94ce-4891-b038-f00902d4cc5f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4f3d0e6b-94ce-4891-b038-f00902d4cc5f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4f3d0e6b-94ce-4891-b038-f00902d4cc5f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4f3d0e6b-94ce-4891-b038-f00902d4cc5f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] failed to remove resource iqn.2010-10.org.openstack:4f3d0e6b-94ce-4891-b038-f00902d4cc5f because of JDSS resource iqn.2010-10.org.openstack:4f3d0e6b-94ce-4891-b038-f00902d4cc5f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] deleating volume v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] get snapshots for volume v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] get volume v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442467', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112464', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9864685682637367700', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1dc9296bbaa829a4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303844352', 'san:volume_id': '1dc9296bbaa829a48c2bd529328b4a8bf1a3c97a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85018', 'name': 'v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] delete volume:v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_25c5361d-3ebe-4ab7-a6ff-857245bed602 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] volume v_25c5361d-3ebe-4ab7-a6ff-857245bed602 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=36,cinder:SELECT=53,cinder:DELETE=2,cinder:INSERT=9 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:57:48 user cinder-volume[73403]: DEBUG cinder.quota [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Created reservations ['2b9115ef-4361-490f-a997-713a8afd0952', 'c8419582-d287-40d8-8330-1f5472c5f511', '3826832a-c02f-4ebf-ba99-c0d9dde55087', 'bb255700-9fcb-40a8-85c3-d1cce478d907'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:57:49 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=54,cinder:INSERT=11,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:57:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:57:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:57:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303844352', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:57:49 user cinder-volume[73403]: DEBUG cinder.manager [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:57:49 user cinder-volume[73403]: INFO cinder.volume.manager [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Deleted volume successfully. Apr 14 02:57:49 user cinder-volume[73403]: DEBUG cinder.coordination [req-da355ede-87b7-4a66-9086-734b3a90650b req-a312fc5a-bf47-4be1-9c5e-777116bdd94c tempest-VolumesSnapshotsTestJSON-1239932062 None] Lock "cinder-25c5361d-3ebe-4ab7-a6ff-857245bed602-delete_volume" released by "delete_volume" :: held 3.610s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:57:50 user cinder-volume[73403]: INFO cinder.volume.manager [None req-15fd2c19-eaa0-4d03-a359-41a911c50cfe tempest-GroupSnapshotsV319Test-469280145 None] Group tempest-GroupSnapshotsV319Test-Group-1608069520: creating Apr 14 02:57:50 user cinder-volume[73403]: INFO cinder.volume.manager [None req-15fd2c19-eaa0-4d03-a359-41a911c50cfe tempest-GroupSnapshotsV319Test-469280145 None] Group tempest-GroupSnapshotsV319Test-Group-1608069520: created successfully Apr 14 02:57:50 user cinder-volume[73403]: INFO cinder.volume.manager [None req-15fd2c19-eaa0-4d03-a359-41a911c50cfe tempest-GroupSnapshotsV319Test-469280145 None] Create group completed successfully. Apr 14 02:57:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] volume v_4f3d0e6b-94ce-4891-b038-f00902d4cc5f deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:57:51 user cinder-volume[73403]: DEBUG cinder.quota [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Created reservations ['de3b1ad8-a11e-4100-8789-f38f57f9b843', '9c44a189-0ecc-4ea8-87aa-2282ac7ed063', '229e5ccb-1ee9-4cc9-b97e-0b01b9e57663', '58ca2b9f-e845-4dbf-998c-b515126a6dc1'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:57:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:57:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:57:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303926272', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.manager [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:57:52 user cinder-volume[73403]: INFO cinder.volume.manager [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Deleted volume successfully. Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Flow 'volume_create_manager' (265bc94d-4ba2-4a16-a1d6-e2f5e88593c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5073ca8e-3151-4eb2-befc-d9af94fac02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Acquiring lock "cinder-1c3b6176-90dc-4f51-b393-442f39772db7-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5073ca8e-3151-4eb2-befc-d9af94fac02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1343499273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61a12292-1143-4a0e-86c7-041d6c3ec35d,host='user@joviandss-2#joviandss-2',id=a6828e2e-004f-4b1c-a4da-43d9a017f383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b64362b004149329443d672eda0ce7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:57:52Z,use_quota=True,user_id='7777849da8fa4c499eb15e9d434cabaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a14745ff-3ee4-435c-a8cb-99aa234cc955),volume_type_id=a14745ff-3ee4-435c-a8cb-99aa234cc955)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bbc7b3-65a0-48f5-ad8b-5d0a6d06fb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bbc7b3-65a0-48f5-ad8b-5d0a6d06fb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60db629-8b75-4616-bd08-3a320d39d555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60db629-8b75-4616-bd08-3a320d39d555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6828e2e-004f-4b1c-a4da-43d9a017f383', 'volume_name': 'volume-a6828e2e-004f-4b1c-a4da-43d9a017f383', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a8a95c-acff-4538-a9f8-72194fa29628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a8a95c-acff-4538-a9f8-72194fa29628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89b613b-abd5-464c-a990-92b0d4cb60ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:52 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Volume a6828e2e-004f-4b1c-a4da-43d9a017f383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6828e2e-004f-4b1c-a4da-43d9a017f383', 'volume_size': 1} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] creating volume v_a6828e2e-004f-4b1c-a4da-43d9a017f383. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] create volume {'name': 'v_a6828e2e-004f-4b1c-a4da-43d9a017f383', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7e09aa3d-4acc-40c6-ae1e-02e46ea395a6 tempest-VolumesTestJSON-1140083610 None] Lock "cinder-4f3d0e6b-94ce-4891-b038-f00902d4cc5f-delete_volume" released by "delete_volume" :: held 4.460s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Lock "cinder-1c3b6176-90dc-4f51-b393-442f39772db7-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] remove_export for volume: 1c3b6176-90dc-4f51-b393-442f39772db7. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1133359536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1c3b6176-90dc-4f51-b393-442f39772db7,launched_at=2023-04-14T02:57:36Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02607d4950bf47f2b3c36169b8d9f910',provider_auth='CHAP hBGFpKaw ywu9eKBVgp5qSf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c3b6176-90dc-4f51-b393-442f39772db7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:57:35Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:57:53Z,updated_at=2023-04-14T02:57:53Z,use_quota=True,user_id='804fe97e7307409c8417c65a581b6354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:1c3b6176-90dc-4f51-b393-442f39772db7. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] detach volume v_1c3b6176-90dc-4f51-b393-442f39772db7 from target iqn.2010-10.org.openstack:1c3b6176-90dc-4f51-b393-442f39772db7 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c3b6176-90dc-4f51-b393-442f39772db7/luns/v_1c3b6176-90dc-4f51-b393-442f39772db7 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c3b6176-90dc-4f51-b393-442f39772db7/luns/v_1c3b6176-90dc-4f51-b393-442f39772db7 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1c3b6176-90dc-4f51-b393-442f39772db7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c3b6176-90dc-4f51-b393-442f39772db7/luns/v_1c3b6176-90dc-4f51-b393-442f39772db7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c3b6176-90dc-4f51-b393-442f39772db7/luns/v_1c3b6176-90dc-4f51-b393-442f39772db7 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] failed to remove resource iqn.2010-10.org.openstack:1c3b6176-90dc-4f51-b393-442f39772db7 because of JDSS resource v_1c3b6176-90dc-4f51-b393-442f39772db7 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] delete target: iqn.2010-10.org.openstack:1c3b6176-90dc-4f51-b393-442f39772db7 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] delete target iqn.2010-10.org.openstack:1c3b6176-90dc-4f51-b393-442f39772db7 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c3b6176-90dc-4f51-b393-442f39772db7 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c3b6176-90dc-4f51-b393-442f39772db7 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1c3b6176-90dc-4f51-b393-442f39772db7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c3b6176-90dc-4f51-b393-442f39772db7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c3b6176-90dc-4f51-b393-442f39772db7 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] failed to remove resource iqn.2010-10.org.openstack:1c3b6176-90dc-4f51-b393-442f39772db7 because of JDSS resource iqn.2010-10.org.openstack:1c3b6176-90dc-4f51-b393-442f39772db7 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] deleating volume v_1c3b6176-90dc-4f51-b393-442f39772db7 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] get snapshots for volume v_1c3b6176-90dc-4f51-b393-442f39772db7 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c3b6176-90dc-4f51-b393-442f39772db7/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c3b6176-90dc-4f51-b393-442f39772db7/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c3b6176-90dc-4f51-b393-442f39772db7/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] get volume v_1c3b6176-90dc-4f51-b393-442f39772db7 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:57:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c3b6176-90dc-4f51-b393-442f39772db7 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c3b6176-90dc-4f51-b393-442f39772db7 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1c3b6176-90dc-4f51-b393-442f39772db7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442465', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112443', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3672785803180507990', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '79a30a382b58966c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303856640', 'san:volume_id': '79a30a382b58966c9fc799593c83d2294fe74350', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '82669', 'name': 'v_1c3b6176-90dc-4f51-b393-442f39772db7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c3b6176-90dc-4f51-b393-442f39772db7 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] delete volume:v_1c3b6176-90dc-4f51-b393-442f39772db7 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:57:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c3b6176-90dc-4f51-b393-442f39772db7 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c3b6176-90dc-4f51-b393-442f39772db7 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a6828e2e-004f-4b1c-a4da-43d9a017f383', 'is_clone': False, 'name': 'v_a6828e2e-004f-4b1c-a4da-43d9a017f383'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89b613b-abd5-464c-a990-92b0d4cb60ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6828e2e-004f-4b1c-a4da-43d9a017f383', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464900e8-63b5-4144-88ee-c7e31ce839d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:53 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Volume volume-a6828e2e-004f-4b1c-a4da-43d9a017f383 (a6828e2e-004f-4b1c-a4da-43d9a017f383): created successfully Apr 14 02:57:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464900e8-63b5-4144-88ee-c7e31ce839d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Flow 'volume_create_manager' (265bc94d-4ba2-4a16-a1d6-e2f5e88593c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:57:53 user cinder-volume[73403]: INFO cinder.volume.manager [None req-1933d497-d0d8-4f77-973d-9d0521dac9ae tempest-GroupSnapshotsV319Test-469280145 None] Created volume successfully. Apr 14 02:57:54 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:57:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Flow 'volume_create_manager' (7f7d278f-3069-4f41-a0c6-3675deef760b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:57:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b11254-92f9-430c-9ac2-234992ac734c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b11254-92f9-430c-9ac2-234992ac734c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-758461537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1f482b52-8fb0-4574-abfe-40ec9b903fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c21888b9bf483093e179270819d025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:57:54Z,use_quota=True,user_id='c87f0c7e890f47649f2dccb130b5e853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7eac19f-9b60-487e-bc77-fd7ee2d8e211),volume_type_id=f7eac19f-9b60-487e-bc77-fd7ee2d8e211)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c5fc77e-8300-449b-b8fe-29eb723e5a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c5fc77e-8300-449b-b8fe-29eb723e5a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ed5dfd-d277-4682-abb1-f3c1f4ba9833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ed5dfd-d277-4682-abb1-f3c1f4ba9833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f482b52-8fb0-4574-abfe-40ec9b903fc9', 'volume_name': 'volume-1f482b52-8fb0-4574-abfe-40ec9b903fc9', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49a5d3c-2e24-4fa7-ba10-432e08bddd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49a5d3c-2e24-4fa7-ba10-432e08bddd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2519d40-03be-4ebe-a6fe-de11e5c78126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:54 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Volume 1f482b52-8fb0-4574-abfe-40ec9b903fc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f482b52-8fb0-4574-abfe-40ec9b903fc9', 'volume_size': 1} Apr 14 02:57:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] creating volume v_1f482b52-8fb0-4574-abfe-40ec9b903fc9. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:57:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] create volume {'name': 'v_1f482b52-8fb0-4574-abfe-40ec9b903fc9', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:57:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:54 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8d9eb714-6ad8-4ef1-9c4b-c2797b8fe8d4 tempest-GroupsV320Test-1769455065 None] Group tempest-GroupsV320Test-Group-758498208: creating Apr 14 02:57:54 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8d9eb714-6ad8-4ef1-9c4b-c2797b8fe8d4 tempest-GroupsV320Test-1769455065 None] Group tempest-GroupsV320Test-Group-758498208: created successfully Apr 14 02:57:54 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8d9eb714-6ad8-4ef1-9c4b-c2797b8fe8d4 tempest-GroupsV320Test-1769455065 None] Create group completed successfully. Apr 14 02:57:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_1f482b52-8fb0-4574-abfe-40ec9b903fc9', 'is_clone': False, 'name': 'v_1f482b52-8fb0-4574-abfe-40ec9b903fc9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2519d40-03be-4ebe-a6fe-de11e5c78126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f482b52-8fb0-4574-abfe-40ec9b903fc9', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e60417-d465-4446-bfc6-d3724f24a566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:57:55 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Volume volume-1f482b52-8fb0-4574-abfe-40ec9b903fc9 (1f482b52-8fb0-4574-abfe-40ec9b903fc9): created successfully Apr 14 02:57:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e60417-d465-4446-bfc6-d3724f24a566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:57:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Flow 'volume_create_manager' (7f7d278f-3069-4f41-a0c6-3675deef760b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:57:55 user cinder-volume[73403]: INFO cinder.volume.manager [None req-0dd7d567-d940-4e67-861f-0504f9a631ca tempest-VolumeTypesTest-1077925283 None] Created volume successfully. Apr 14 02:57:55 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a8183164-aace-47b3-a8ba-ee93bdffbc32 tempest-GroupSnapshotsV319Test-469280145 None] GroupSnapshot ac22522d-0184-4ad4-8c52-6541a6f68c05: creating. Apr 14 02:57:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a8183164-aace-47b3-a8ba-ee93bdffbc32 tempest-GroupSnapshotsV319Test-469280145 None] Group snapshot ac22522d-0184-4ad4-8c52-6541a6f68c05: creating. {{(pid=73403) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4129}} Apr 14 02:57:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a8183164-aace-47b3-a8ba-ee93bdffbc32 tempest-GroupSnapshotsV319Test-469280145 None] create snapshot 19d0bdc0-820c-4aad-8630-9118ed68116e for volume a6828e2e-004f-4b1c-a4da-43d9a017f383 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:57:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a8183164-aace-47b3-a8ba-ee93bdffbc32 tempest-GroupSnapshotsV319Test-469280145 None] cloning v_a6828e2e-004f-4b1c-a4da-43d9a017f383 to s_19d0bdc0-820c-4aad-8630-9118ed68116e {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:57:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a8183164-aace-47b3-a8ba-ee93bdffbc32 tempest-GroupSnapshotsV319Test-469280145 None] create snapshot s_19d0bdc0-820c-4aad-8630-9118ed68116e {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:57:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8183164-aace-47b3-a8ba-ee93bdffbc32 tempest-GroupSnapshotsV319Test-469280145 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6828e2e-004f-4b1c-a4da-43d9a017f383/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8183164-aace-47b3-a8ba-ee93bdffbc32 tempest-GroupSnapshotsV319Test-469280145 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6828e2e-004f-4b1c-a4da-43d9a017f383/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c3b6176-90dc-4f51-b393-442f39772db7 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] volume v_1c3b6176-90dc-4f51-b393-442f39772db7 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:57:55 user cinder-volume[73403]: DEBUG cinder.quota [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Created reservations ['c9fb56a1-92cb-4673-a7e3-09314727a166', 'db27faa6-6317-49e1-8247-4c9e7e22ad01', '745ff847-e0b9-4692-812f-b272fc560467', 'b97ef218-8464-4c80-b380-17a632292a02'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:57:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:57:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:57:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG cinder.quota [None req-b8d580a9-e802-4c0f-8660-c917665c9ef9 tempest-GroupsV320Test-1769455065 None] Created reservations ['75490dc1-43c0-46cf-8cd7-55815fb61e9a'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b8d580a9-e802-4c0f-8660-c917665c9ef9 tempest-GroupsV320Test-1769455065 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b8d580a9-e802-4c0f-8660-c917665c9ef9 tempest-GroupsV320Test-1769455065 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8d580a9-e802-4c0f-8660-c917665c9ef9 tempest-GroupsV320Test-1769455065 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8d580a9-e802-4c0f-8660-c917665c9ef9 tempest-GroupsV320Test-1769455065 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303832064', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG cinder.manager [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:57:56 user cinder-volume[73403]: INFO cinder.volume.manager [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Deleted volume successfully. Apr 14 02:57:56 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ea2ecbd9-77bf-41f4-91bb-c31f93499a37 tempest-VolumesTestJSON-1140083610 None] Lock "cinder-1c3b6176-90dc-4f51-b393-442f39772db7-delete_volume" released by "delete_volume" :: held 3.698s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8183164-aace-47b3-a8ba-ee93bdffbc32 tempest-GroupSnapshotsV319Test-469280145 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_19d0bdc0-820c-4aad-8630-9118ed68116e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6828e2e-004f-4b1c-a4da-43d9a017f383/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a8183164-aace-47b3-a8ba-ee93bdffbc32 tempest-GroupSnapshotsV319Test-469280145 None] create volume s_19d0bdc0-820c-4aad-8630-9118ed68116e from snapshot s_19d0bdc0-820c-4aad-8630-9118ed68116e {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8183164-aace-47b3-a8ba-ee93bdffbc32 tempest-GroupSnapshotsV319Test-469280145 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6828e2e-004f-4b1c-a4da-43d9a017f383/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8183164-aace-47b3-a8ba-ee93bdffbc32 tempest-GroupSnapshotsV319Test-469280145 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6828e2e-004f-4b1c-a4da-43d9a017f383/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=30,cinder:SELECT=63,cinder:INSERT=5,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=31,cinder:DELETE=3,cinder:SELECT=62,cinder:INSERT=4 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a8576ad7-cb21-47c5-990e-ae154719c905 tempest-VolumeTypesTest-1077925283 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a8576ad7-cb21-47c5-990e-ae154719c905 tempest-VolumeTypesTest-1077925283 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8576ad7-cb21-47c5-990e-ae154719c905 tempest-VolumeTypesTest-1077925283 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8576ad7-cb21-47c5-990e-ae154719c905 tempest-VolumeTypesTest-1077925283 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8576ad7-cb21-47c5-990e-ae154719c905 tempest-VolumeTypesTest-1077925283 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303832064', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a8576ad7-cb21-47c5-990e-ae154719c905 tempest-VolumeTypesTest-1077925283 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:57:56 user cinder-volume[73403]: DEBUG cinder.manager [None req-a8576ad7-cb21-47c5-990e-ae154719c905 tempest-VolumeTypesTest-1077925283 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:57:56 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a8576ad7-cb21-47c5-990e-ae154719c905 tempest-VolumeTypesTest-1077925283 None] Retype volume completed successfully. Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8d580a9-e802-4c0f-8660-c917665c9ef9 tempest-GroupsV320Test-1769455065 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303819776', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b8d580a9-e802-4c0f-8660-c917665c9ef9 tempest-GroupsV320Test-1769455065 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.manager [None req-b8d580a9-e802-4c0f-8660-c917665c9ef9 tempest-GroupsV320Test-1769455065 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:57:57 user cinder-volume[73403]: INFO cinder.volume.manager [None req-b8d580a9-e802-4c0f-8660-c917665c9ef9 tempest-GroupsV320Test-1769455065 None] Delete group completed successfully. Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8183164-aace-47b3-a8ba-ee93bdffbc32 tempest-GroupSnapshotsV319Test-469280145 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_a6828e2e-004f-4b1c-a4da-43d9a017f383@s_19d0bdc0-820c-4aad-8630-9118ed68116e', 'is_clone': True, 'full_name': 'Pool-0/s_19d0bdc0-820c-4aad-8630-9118ed68116e', 'name': 's_19d0bdc0-820c-4aad-8630-9118ed68116e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6828e2e-004f-4b1c-a4da-43d9a017f383/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8183164-aace-47b3-a8ba-ee93bdffbc32 tempest-GroupSnapshotsV319Test-469280145 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19d0bdc0-820c-4aad-8630-9118ed68116e/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8183164-aace-47b3-a8ba-ee93bdffbc32 tempest-GroupSnapshotsV319Test-469280145 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19d0bdc0-820c-4aad-8630-9118ed68116e/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8183164-aace-47b3-a8ba-ee93bdffbc32 tempest-GroupSnapshotsV319Test-469280145 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19d0bdc0-820c-4aad-8630-9118ed68116e/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a8183164-aace-47b3-a8ba-ee93bdffbc32 tempest-GroupSnapshotsV319Test-469280145 None] volume s_19d0bdc0-820c-4aad-8630-9118ed68116e properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:57:57 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a8183164-aace-47b3-a8ba-ee93bdffbc32 tempest-GroupSnapshotsV319Test-469280145 None] group_snapshot ac22522d-0184-4ad4-8c52-6541a6f68c05: created successfully Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.coordination [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Acquiring lock "cinder-1f482b52-8fb0-4574-abfe-40ec9b903fc9-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.coordination [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Lock "cinder-1f482b52-8fb0-4574-abfe-40ec9b903fc9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] remove_export for volume: 1f482b52-8fb0-4574-abfe-40ec9b903fc9. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-758461537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1f482b52-8fb0-4574-abfe-40ec9b903fc9,launched_at=2023-04-14T02:57:55Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='61c21888b9bf483093e179270819d025',provider_auth='CHAP xWqEbDBe KUBJhEarlsDyP7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f482b52-8fb0-4574-abfe-40ec9b903fc9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:57:54Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:57:58Z,updated_at=2023-04-14T02:57:58Z,use_quota=True,user_id='c87f0c7e890f47649f2dccb130b5e853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aeb33fd9-2863-45c8-8f52-34ec501ffd6d),volume_type_id=aeb33fd9-2863-45c8-8f52-34ec501ffd6d) from target:iqn.2010-10.org.openstack:1f482b52-8fb0-4574-abfe-40ec9b903fc9. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] detach volume v_1f482b52-8fb0-4574-abfe-40ec9b903fc9 from target iqn.2010-10.org.openstack:1f482b52-8fb0-4574-abfe-40ec9b903fc9 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f482b52-8fb0-4574-abfe-40ec9b903fc9/luns/v_1f482b52-8fb0-4574-abfe-40ec9b903fc9 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f482b52-8fb0-4574-abfe-40ec9b903fc9/luns/v_1f482b52-8fb0-4574-abfe-40ec9b903fc9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1f482b52-8fb0-4574-abfe-40ec9b903fc9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f482b52-8fb0-4574-abfe-40ec9b903fc9/luns/v_1f482b52-8fb0-4574-abfe-40ec9b903fc9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f482b52-8fb0-4574-abfe-40ec9b903fc9/luns/v_1f482b52-8fb0-4574-abfe-40ec9b903fc9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] failed to remove resource iqn.2010-10.org.openstack:1f482b52-8fb0-4574-abfe-40ec9b903fc9 because of JDSS resource v_1f482b52-8fb0-4574-abfe-40ec9b903fc9 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] delete target: iqn.2010-10.org.openstack:1f482b52-8fb0-4574-abfe-40ec9b903fc9 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] delete target iqn.2010-10.org.openstack:1f482b52-8fb0-4574-abfe-40ec9b903fc9 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f482b52-8fb0-4574-abfe-40ec9b903fc9 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f482b52-8fb0-4574-abfe-40ec9b903fc9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1f482b52-8fb0-4574-abfe-40ec9b903fc9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f482b52-8fb0-4574-abfe-40ec9b903fc9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f482b52-8fb0-4574-abfe-40ec9b903fc9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] failed to remove resource iqn.2010-10.org.openstack:1f482b52-8fb0-4574-abfe-40ec9b903fc9 because of JDSS resource iqn.2010-10.org.openstack:1f482b52-8fb0-4574-abfe-40ec9b903fc9 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] deleating volume v_1f482b52-8fb0-4574-abfe-40ec9b903fc9 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] get snapshots for volume v_1f482b52-8fb0-4574-abfe-40ec9b903fc9 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f482b52-8fb0-4574-abfe-40ec9b903fc9/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f482b52-8fb0-4574-abfe-40ec9b903fc9/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f482b52-8fb0-4574-abfe-40ec9b903fc9/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] get volume v_1f482b52-8fb0-4574-abfe-40ec9b903fc9 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:57:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f482b52-8fb0-4574-abfe-40ec9b903fc9 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f482b52-8fb0-4574-abfe-40ec9b903fc9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1f482b52-8fb0-4574-abfe-40ec9b903fc9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442483', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112491', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1867556646366458072', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b6bf3e64e111576d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303807488', 'san:volume_id': 'b6bf3e64e111576d3cd83eb892ebba30f624e6b7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84595', 'name': 'v_1f482b52-8fb0-4574-abfe-40ec9b903fc9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f482b52-8fb0-4574-abfe-40ec9b903fc9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] delete volume:v_1f482b52-8fb0-4574-abfe-40ec9b903fc9 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:57:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f482b52-8fb0-4574-abfe-40ec9b903fc9 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f482b52-8fb0-4574-abfe-40ec9b903fc9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:58 user cinder-volume[73403]: INFO cinder.volume.manager [None req-30b5ec8a-70ff-4a85-8e65-00422e9419a6 tempest-GroupSnapshotsV319Test-469280145 None] group_snapshot ac22522d-0184-4ad4-8c52-6541a6f68c05: deleting Apr 14 02:57:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-30b5ec8a-70ff-4a85-8e65-00422e9419a6 tempest-GroupSnapshotsV319Test-469280145 None] group_snapshot ac22522d-0184-4ad4-8c52-6541a6f68c05: deleting {{(pid=73403) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4304}} Apr 14 02:57:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-30b5ec8a-70ff-4a85-8e65-00422e9419a6 tempest-GroupSnapshotsV319Test-469280145 None] deleating snapshot s_19d0bdc0-820c-4aad-8630-9118ed68116e. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:57:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-30b5ec8a-70ff-4a85-8e65-00422e9419a6 tempest-GroupSnapshotsV319Test-469280145 None] get snapshots for volume s_19d0bdc0-820c-4aad-8630-9118ed68116e {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:57:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30b5ec8a-70ff-4a85-8e65-00422e9419a6 tempest-GroupSnapshotsV319Test-469280145 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19d0bdc0-820c-4aad-8630-9118ed68116e/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30b5ec8a-70ff-4a85-8e65-00422e9419a6 tempest-GroupSnapshotsV319Test-469280145 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19d0bdc0-820c-4aad-8630-9118ed68116e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30b5ec8a-70ff-4a85-8e65-00422e9419a6 tempest-GroupSnapshotsV319Test-469280145 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19d0bdc0-820c-4aad-8630-9118ed68116e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-30b5ec8a-70ff-4a85-8e65-00422e9419a6 tempest-GroupSnapshotsV319Test-469280145 None] get volume s_19d0bdc0-820c-4aad-8630-9118ed68116e info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:57:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30b5ec8a-70ff-4a85-8e65-00422e9419a6 tempest-GroupSnapshotsV319Test-469280145 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19d0bdc0-820c-4aad-8630-9118ed68116e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30b5ec8a-70ff-4a85-8e65-00422e9419a6 tempest-GroupSnapshotsV319Test-469280145 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19d0bdc0-820c-4aad-8630-9118ed68116e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:57:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30b5ec8a-70ff-4a85-8e65-00422e9419a6 tempest-GroupSnapshotsV319Test-469280145 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_a6828e2e-004f-4b1c-a4da-43d9a017f383@s_19d0bdc0-820c-4aad-8630-9118ed68116e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_19d0bdc0-820c-4aad-8630-9118ed68116e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442485', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112497', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8410228927312960254', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '236e2e33c5f22b1a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303807488', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84396', 'name': 's_19d0bdc0-820c-4aad-8630-9118ed68116e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19d0bdc0-820c-4aad-8630-9118ed68116e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:57:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-30b5ec8a-70ff-4a85-8e65-00422e9419a6 tempest-GroupSnapshotsV319Test-469280145 None] delete snapshot s_19d0bdc0-820c-4aad-8630-9118ed68116e of volume v_a6828e2e-004f-4b1c-a4da-43d9a017f383 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:57:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30b5ec8a-70ff-4a85-8e65-00422e9419a6 tempest-GroupSnapshotsV319Test-469280145 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6828e2e-004f-4b1c-a4da-43d9a017f383/snapshots/s_19d0bdc0-820c-4aad-8630-9118ed68116e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:57:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30b5ec8a-70ff-4a85-8e65-00422e9419a6 tempest-GroupSnapshotsV319Test-469280145 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6828e2e-004f-4b1c-a4da-43d9a017f383/snapshots/s_19d0bdc0-820c-4aad-8630-9118ed68116e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f482b52-8fb0-4574-abfe-40ec9b903fc9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] volume v_1f482b52-8fb0-4574-abfe-40ec9b903fc9 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:58:00 user cinder-volume[73403]: WARNING cinder.quota [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-900811419 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-900811419, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:58:00 user cinder-volume[73403]: WARNING cinder.quota [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-900811419 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-900811419, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:58:00 user cinder-volume[73403]: DEBUG cinder.quota [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Created reservations ['4d3f8742-ca02-4c80-80de-4da806d18dfb', 'fa5cf525-6c18-49fe-afe2-9221d97915cd', '1678883a-db53-46eb-b488-e8b3aabf6180', '62d97bdc-ea3f-4264-9c89-5ac91474f510'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:58:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:58:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-30b5ec8a-70ff-4a85-8e65-00422e9419a6 tempest-GroupSnapshotsV319Test-469280145 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6828e2e-004f-4b1c-a4da-43d9a017f383/snapshots/s_19d0bdc0-820c-4aad-8630-9118ed68116e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-30b5ec8a-70ff-4a85-8e65-00422e9419a6 tempest-GroupSnapshotsV319Test-469280145 None] snapshot s_19d0bdc0-820c-4aad-8630-9118ed68116e deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:58:01 user cinder-volume[73403]: WARNING cinder.quota [None req-30b5ec8a-70ff-4a85-8e65-00422e9419a6 tempest-GroupSnapshotsV319Test-469280145 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1799096176 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1799096176, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:58:01 user cinder-volume[73403]: WARNING cinder.quota [None req-30b5ec8a-70ff-4a85-8e65-00422e9419a6 tempest-GroupSnapshotsV319Test-469280145 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1799096176 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1799096176, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:58:01 user cinder-volume[73403]: DEBUG cinder.quota [None req-30b5ec8a-70ff-4a85-8e65-00422e9419a6 tempest-GroupSnapshotsV319Test-469280145 None] Created reservations ['5e04272f-09bb-4b19-93fa-e2d753989783', '9121cf58-d21f-47c3-a37d-7942d2768eb9', '7d8cb35c-e562-4cda-beee-2e31d030f09b', '383c7f62-530a-4a12-ae92-64dfd65384b8'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:01 user cinder-volume[73403]: INFO cinder.volume.manager [None req-30b5ec8a-70ff-4a85-8e65-00422e9419a6 tempest-GroupSnapshotsV319Test-469280145 None] group_snapshot ac22522d-0184-4ad4-8c52-6541a6f68c05: deleted successfully Apr 14 02:58:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303913984', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:58:01 user cinder-volume[73403]: DEBUG cinder.manager [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:58:01 user cinder-volume[73403]: INFO cinder.volume.manager [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Deleted volume successfully. Apr 14 02:58:01 user cinder-volume[73403]: DEBUG cinder.coordination [None req-35f9e6c7-c3ea-45ed-ab11-6cc533c3d925 tempest-VolumeTypesTest-1077925283 None] Lock "cinder-1f482b52-8fb0-4574-abfe-40ec9b903fc9-delete_volume" released by "delete_volume" :: held 3.828s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:58:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] remove_export for volume: a6828e2e-004f-4b1c-a4da-43d9a017f383. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:58:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:58:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1343499273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61a12292-1143-4a0e-86c7-041d6c3ec35d,host='user@joviandss-2#joviandss-2',id=a6828e2e-004f-4b1c-a4da-43d9a017f383,launched_at=2023-04-14T02:57:54Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b64362b004149329443d672eda0ce7b',provider_auth='CHAP WEnLbicM t1ukmSUQB03be8',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6828e2e-004f-4b1c-a4da-43d9a017f383 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:57:52Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T02:58:03Z,use_quota=True,user_id='7777849da8fa4c499eb15e9d434cabaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a14745ff-3ee4-435c-a8cb-99aa234cc955),volume_type_id=a14745ff-3ee4-435c-a8cb-99aa234cc955) from target:iqn.2010-10.org.openstack:a6828e2e-004f-4b1c-a4da-43d9a017f383. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:58:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] detach volume v_a6828e2e-004f-4b1c-a4da-43d9a017f383 from target iqn.2010-10.org.openstack:a6828e2e-004f-4b1c-a4da-43d9a017f383 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:58:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6828e2e-004f-4b1c-a4da-43d9a017f383/luns/v_a6828e2e-004f-4b1c-a4da-43d9a017f383 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6828e2e-004f-4b1c-a4da-43d9a017f383/luns/v_a6828e2e-004f-4b1c-a4da-43d9a017f383 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a6828e2e-004f-4b1c-a4da-43d9a017f383 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6828e2e-004f-4b1c-a4da-43d9a017f383/luns/v_a6828e2e-004f-4b1c-a4da-43d9a017f383'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6828e2e-004f-4b1c-a4da-43d9a017f383/luns/v_a6828e2e-004f-4b1c-a4da-43d9a017f383 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] failed to remove resource iqn.2010-10.org.openstack:a6828e2e-004f-4b1c-a4da-43d9a017f383 because of JDSS resource v_a6828e2e-004f-4b1c-a4da-43d9a017f383 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:58:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] delete target: iqn.2010-10.org.openstack:a6828e2e-004f-4b1c-a4da-43d9a017f383 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:58:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] delete target iqn.2010-10.org.openstack:a6828e2e-004f-4b1c-a4da-43d9a017f383 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:58:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6828e2e-004f-4b1c-a4da-43d9a017f383 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6828e2e-004f-4b1c-a4da-43d9a017f383 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a6828e2e-004f-4b1c-a4da-43d9a017f383 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6828e2e-004f-4b1c-a4da-43d9a017f383'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6828e2e-004f-4b1c-a4da-43d9a017f383 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] failed to remove resource iqn.2010-10.org.openstack:a6828e2e-004f-4b1c-a4da-43d9a017f383 because of JDSS resource iqn.2010-10.org.openstack:a6828e2e-004f-4b1c-a4da-43d9a017f383 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:58:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] deleating volume v_a6828e2e-004f-4b1c-a4da-43d9a017f383 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:58:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] get snapshots for volume v_a6828e2e-004f-4b1c-a4da-43d9a017f383 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:58:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6828e2e-004f-4b1c-a4da-43d9a017f383/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6828e2e-004f-4b1c-a4da-43d9a017f383/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6828e2e-004f-4b1c-a4da-43d9a017f383/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] get volume v_a6828e2e-004f-4b1c-a4da-43d9a017f383 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6828e2e-004f-4b1c-a4da-43d9a017f383 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6828e2e-004f-4b1c-a4da-43d9a017f383 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a6828e2e-004f-4b1c-a4da-43d9a017f383', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442482', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112486', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10643302331603815306', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '85d74f5d2db72edb', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303913984', 'san:volume_id': '85d74f5d2db72edbd777fb61266ea51b07a658cd', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84264', 'name': 'v_a6828e2e-004f-4b1c-a4da-43d9a017f383', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6828e2e-004f-4b1c-a4da-43d9a017f383 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] delete volume:v_a6828e2e-004f-4b1c-a4da-43d9a017f383 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6828e2e-004f-4b1c-a4da-43d9a017f383 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6828e2e-004f-4b1c-a4da-43d9a017f383 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Flow 'volume_create_manager' (46ba9a43-943b-4510-9dc6-8e748ee3db80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6367ae8e-3e7b-4792-b52a-e18f641a90ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6367ae8e-3e7b-4792-b52a-e18f641a90ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-864046626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4a287afd-8a15-47ce-8be2-1336f169e5ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9c6e4d9b634e52be84dd2198c7edb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:58:04Z,use_quota=True,user_id='df67e0fdea154b589565d238d1c457b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36e53a0-54a1-4b9e-937a-575111c285f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36e53a0-54a1-4b9e-937a-575111c285f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e7a91a-5993-4bb3-9182-27e8a51841f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e7a91a-5993-4bb3-9182-27e8a51841f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a287afd-8a15-47ce-8be2-1336f169e5ce', 'volume_name': 'volume-4a287afd-8a15-47ce-8be2-1336f169e5ce', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a96fc8-0cf9-4f56-a48d-0ee97c591d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a96fc8-0cf9-4f56-a48d-0ee97c591d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e29d292-aa55-42dc-9b84-e6d65cb716ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:03 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Volume 4a287afd-8a15-47ce-8be2-1336f169e5ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a287afd-8a15-47ce-8be2-1336f169e5ce', 'volume_size': 1} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] creating volume v_4a287afd-8a15-47ce-8be2-1336f169e5ce. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] create volume {'name': 'v_4a287afd-8a15-47ce-8be2-1336f169e5ce', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114303913984', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:58:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:58:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_4a287afd-8a15-47ce-8be2-1336f169e5ce', 'is_clone': False, 'name': 'v_4a287afd-8a15-47ce-8be2-1336f169e5ce'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e29d292-aa55-42dc-9b84-e6d65cb716ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a287afd-8a15-47ce-8be2-1336f169e5ce', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8884b75d-0265-4fd4-b519-8708a3d59d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:04 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Volume volume-4a287afd-8a15-47ce-8be2-1336f169e5ce (4a287afd-8a15-47ce-8be2-1336f169e5ce): created successfully Apr 14 02:58:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8884b75d-0265-4fd4-b519-8708a3d59d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Flow 'volume_create_manager' (46ba9a43-943b-4510-9dc6-8e748ee3db80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:04 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a1c9ced1-ec27-4782-8703-e753f6f880f8 tempest-VolumesTransfersV355Test-1318065877 None] Created volume successfully. Apr 14 02:58:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6828e2e-004f-4b1c-a4da-43d9a017f383 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] volume v_a6828e2e-004f-4b1c-a4da-43d9a017f383 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:58:05 user cinder-volume[73403]: DEBUG cinder.quota [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Created reservations ['a6903a47-2428-44ab-a9b6-f01cbfeeb6ec'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:05 user cinder-volume[73403]: WARNING cinder.quota [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1799096176 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1799096176, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:58:05 user cinder-volume[73403]: DEBUG cinder.quota [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Created reservations ['ca9f4529-e3df-41e8-a1d5-b09452619c69', '53e8b826-8c51-427b-b17a-bf28352c8f47', '3a757c56-e79f-4ecd-83cd-97ac944877fa', 'e8e3560e-af9a-4dd1-baf4-458270a0627a'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:05 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=31,cinder:SELECT=60,cinder:INSERT=8,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:58:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:58:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303901696', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:58:06 user cinder-volume[73403]: DEBUG cinder.manager [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:58:06 user cinder-volume[73403]: INFO cinder.volume.manager [None req-ef37c7d3-5b7d-43d5-8a3b-90b8633f079b tempest-GroupSnapshotsV319Test-469280145 None] Delete group completed successfully. Apr 14 02:58:06 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8ffbf9c0-4a33-4a46-a968-23631f14d7fe tempest-VolumesTransfersV355Test-736298536 None] Transfer volume completed successfully. Apr 14 02:58:07 user cinder-volume[73403]: DEBUG cinder.coordination [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Acquiring lock "cinder-4a287afd-8a15-47ce-8be2-1336f169e5ce-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:58:07 user cinder-volume[73403]: DEBUG cinder.coordination [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Lock "cinder-4a287afd-8a15-47ce-8be2-1336f169e5ce-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:58:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] remove_export for volume: 4a287afd-8a15-47ce-8be2-1336f169e5ce. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:58:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:58:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-864046626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4a287afd-8a15-47ce-8be2-1336f169e5ce,launched_at=2023-04-14T02:58:05Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa77fae6d222406b9e7b7e478cb0c282',provider_auth='CHAP LgDBXMKs yzGSFAIf5TxVW0',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a287afd-8a15-47ce-8be2-1336f169e5ce 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:04Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:58:08Z,updated_at=2023-04-14T02:58:08Z,use_quota=True,user_id='0ff1d52e76284c228bffb7133d893b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:4a287afd-8a15-47ce-8be2-1336f169e5ce. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:58:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] detach volume v_4a287afd-8a15-47ce-8be2-1336f169e5ce from target iqn.2010-10.org.openstack:4a287afd-8a15-47ce-8be2-1336f169e5ce {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:58:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4a287afd-8a15-47ce-8be2-1336f169e5ce/luns/v_4a287afd-8a15-47ce-8be2-1336f169e5ce {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4a287afd-8a15-47ce-8be2-1336f169e5ce/luns/v_4a287afd-8a15-47ce-8be2-1336f169e5ce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4a287afd-8a15-47ce-8be2-1336f169e5ce not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4a287afd-8a15-47ce-8be2-1336f169e5ce/luns/v_4a287afd-8a15-47ce-8be2-1336f169e5ce'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4a287afd-8a15-47ce-8be2-1336f169e5ce/luns/v_4a287afd-8a15-47ce-8be2-1336f169e5ce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] failed to remove resource iqn.2010-10.org.openstack:4a287afd-8a15-47ce-8be2-1336f169e5ce because of JDSS resource v_4a287afd-8a15-47ce-8be2-1336f169e5ce DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:58:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] delete target: iqn.2010-10.org.openstack:4a287afd-8a15-47ce-8be2-1336f169e5ce {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:58:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] delete target iqn.2010-10.org.openstack:4a287afd-8a15-47ce-8be2-1336f169e5ce {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:58:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4a287afd-8a15-47ce-8be2-1336f169e5ce {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4a287afd-8a15-47ce-8be2-1336f169e5ce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4a287afd-8a15-47ce-8be2-1336f169e5ce not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4a287afd-8a15-47ce-8be2-1336f169e5ce'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4a287afd-8a15-47ce-8be2-1336f169e5ce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] failed to remove resource iqn.2010-10.org.openstack:4a287afd-8a15-47ce-8be2-1336f169e5ce because of JDSS resource iqn.2010-10.org.openstack:4a287afd-8a15-47ce-8be2-1336f169e5ce DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:58:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] deleating volume v_4a287afd-8a15-47ce-8be2-1336f169e5ce {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:58:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] get snapshots for volume v_4a287afd-8a15-47ce-8be2-1336f169e5ce {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:58:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4a287afd-8a15-47ce-8be2-1336f169e5ce/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4a287afd-8a15-47ce-8be2-1336f169e5ce/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Flow 'volume_create_manager' (14945f0b-e32d-409c-8c2a-9e5c7eecc71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028ffa82-db96-4762-bdf8-6b54d476a8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028ffa82-db96-4762-bdf8-6b54d476a8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-670630896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ceda750c-3661-4806-9e27-2013edcf9d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e27d0b5762d4f5088268928796a8488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:58:08Z,use_quota=True,user_id='99087542458c461d99b011861d873e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd74382-4649-4bf8-b929-4a2d8adc7e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd74382-4649-4bf8-b929-4a2d8adc7e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78c2d44-96ed-4769-be0d-358d8255c2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78c2d44-96ed-4769-be0d-358d8255c2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceda750c-3661-4806-9e27-2013edcf9d2f', 'volume_name': 'volume-ceda750c-3661-4806-9e27-2013edcf9d2f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e032392a-7a62-44e1-b4e4-dde1d0504586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e032392a-7a62-44e1-b4e4-dde1d0504586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb3a4dd-5bd1-473d-8c25-a041c5a85722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:08 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Volume ceda750c-3661-4806-9e27-2013edcf9d2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceda750c-3661-4806-9e27-2013edcf9d2f', 'volume_size': 1} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] creating volume v_ceda750c-3661-4806-9e27-2013edcf9d2f. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] create volume {'name': 'v_ceda750c-3661-4806-9e27-2013edcf9d2f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4a287afd-8a15-47ce-8be2-1336f169e5ce/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] get volume v_4a287afd-8a15-47ce-8be2-1336f169e5ce info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4a287afd-8a15-47ce-8be2-1336f169e5ce {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4a287afd-8a15-47ce-8be2-1336f169e5ce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4a287afd-8a15-47ce-8be2-1336f169e5ce', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442493', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112506', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17806293786532549379', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'eed7e9d1f6328728', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303856640', 'san:volume_id': 'eed7e9d1f632872861558895ed5f744e61c213d4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84414', 'name': 'v_4a287afd-8a15-47ce-8be2-1336f169e5ce', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4a287afd-8a15-47ce-8be2-1336f169e5ce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] delete volume:v_4a287afd-8a15-47ce-8be2-1336f169e5ce recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4a287afd-8a15-47ce-8be2-1336f169e5ce {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4a287afd-8a15-47ce-8be2-1336f169e5ce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:08 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:58:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Flow 'volume_create_manager' (c07824ab-f642-4939-a1dc-8be4532c4aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5134270c-1193-45a1-a0bb-f36d9706f01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:09 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=59,cinder:UPDATE=35,cinder:INSERT=5,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5134270c-1193-45a1-a0bb-f36d9706f01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2038217980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d20887d3-f55a-457c-bd6d-70d093474f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98467468e2634791b03e7de02104fb6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:58:09Z,use_quota=True,user_id='68d9c00304044e2fa11fbd652a26306f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63f4b3e-dd97-44bb-93ed-8ac1199bd03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63f4b3e-dd97-44bb-93ed-8ac1199bd03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2741784-bf38-4007-9034-d6f7d49aca28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2741784-bf38-4007-9034-d6f7d49aca28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd20887d3-f55a-457c-bd6d-70d093474f9c', 'volume_name': 'volume-d20887d3-f55a-457c-bd6d-70d093474f9c', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266e1a09-916e-4ac4-9c87-087a8b46a6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266e1a09-916e-4ac4-9c87-087a8b46a6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee19f5a-051a-447e-b9d9-d87405e9200c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:09 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Volume d20887d3-f55a-457c-bd6d-70d093474f9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d20887d3-f55a-457c-bd6d-70d093474f9c', 'volume_size': 1} Apr 14 02:58:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] creating volume v_d20887d3-f55a-457c-bd6d-70d093474f9c. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:58:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] create volume {'name': 'v_d20887d3-f55a-457c-bd6d-70d093474f9c', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:58:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_ceda750c-3661-4806-9e27-2013edcf9d2f', 'is_clone': False, 'name': 'v_ceda750c-3661-4806-9e27-2013edcf9d2f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb3a4dd-5bd1-473d-8c25-a041c5a85722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceda750c-3661-4806-9e27-2013edcf9d2f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c77dadcf-e321-419a-a09c-014bb781548b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:09 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Volume volume-ceda750c-3661-4806-9e27-2013edcf9d2f (ceda750c-3661-4806-9e27-2013edcf9d2f): created successfully Apr 14 02:58:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c77dadcf-e321-419a-a09c-014bb781548b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Flow 'volume_create_manager' (14945f0b-e32d-409c-8c2a-9e5c7eecc71d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:09 user cinder-volume[73403]: INFO cinder.volume.manager [None req-09472a75-86ca-4bd4-99b0-2062613de16a tempest-SnapshotsActionsTest-1419620875 None] Created volume successfully. Apr 14 02:58:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d20887d3-f55a-457c-bd6d-70d093474f9c', 'is_clone': False, 'name': 'v_d20887d3-f55a-457c-bd6d-70d093474f9c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee19f5a-051a-447e-b9d9-d87405e9200c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d20887d3-f55a-457c-bd6d-70d093474f9c', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d446711e-8033-4168-8e14-f5a8a9d14a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:10 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Volume volume-d20887d3-f55a-457c-bd6d-70d093474f9c (d20887d3-f55a-457c-bd6d-70d093474f9c): created successfully Apr 14 02:58:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d446711e-8033-4168-8e14-f5a8a9d14a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Flow 'volume_create_manager' (c07824ab-f642-4939-a1dc-8be4532c4aa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:10 user cinder-volume[73403]: INFO cinder.volume.manager [None req-668c1900-e297-4e33-89e9-3fdfa58a4542 tempest-VolumesListAdminTestJSON-981052236 None] Created volume successfully. Apr 14 02:58:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be17feaa-1eda-4cb8-93d1-7ca391833cc7 tempest-SnapshotsActionsTest-1419620875 None] create snapshot 3daf5d87-24e6-41c6-bf3c-917855a7dbbf for volume ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:58:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be17feaa-1eda-4cb8-93d1-7ca391833cc7 tempest-SnapshotsActionsTest-1419620875 None] cloning v_ceda750c-3661-4806-9e27-2013edcf9d2f to s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:58:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be17feaa-1eda-4cb8-93d1-7ca391833cc7 tempest-SnapshotsActionsTest-1419620875 None] create snapshot s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:58:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be17feaa-1eda-4cb8-93d1-7ca391833cc7 tempest-SnapshotsActionsTest-1419620875 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be17feaa-1eda-4cb8-93d1-7ca391833cc7 tempest-SnapshotsActionsTest-1419620875 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4a287afd-8a15-47ce-8be2-1336f169e5ce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] volume v_4a287afd-8a15-47ce-8be2-1336f169e5ce deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:58:11 user cinder-volume[73403]: DEBUG cinder.quota [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Created reservations ['e8d0ce1e-ae90-40f0-a5e8-9ed609722576', '82ed6415-c392-4de8-9a20-0508c9e11e7f', 'f5736ef8-a00f-40a9-a778-15b4ca4b63ca', 'a6e43b37-e57f-4eef-a9cd-21b21a7f95d4'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:58:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:58:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:11 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:58:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Flow 'volume_create_manager' (799e3c05-254a-44ac-a5c7-e0306c0a2be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (872dfb5b-2ad4-4fe8-9bd6-35511b26977a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (872dfb5b-2ad4-4fe8-9bd6-35511b26977a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1529042904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a83f435c-93f4-418a-b55c-80bcea20a699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98467468e2634791b03e7de02104fb6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:58:12Z,use_quota=True,user_id='68d9c00304044e2fa11fbd652a26306f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7640a9e-6fb7-4ec7-8d46-1e541aeb15a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7640a9e-6fb7-4ec7-8d46-1e541aeb15a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d60d2a0-1b48-406c-aa5e-8c115046c958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d60d2a0-1b48-406c-aa5e-8c115046c958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a83f435c-93f4-418a-b55c-80bcea20a699', 'volume_name': 'volume-a83f435c-93f4-418a-b55c-80bcea20a699', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b0c5d4-e366-41f4-be86-7b5558ec76c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b0c5d4-e366-41f4-be86-7b5558ec76c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20378f50-ebcb-415d-8814-9427fca8db1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:12 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Volume a83f435c-93f4-418a-b55c-80bcea20a699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a83f435c-93f4-418a-b55c-80bcea20a699', 'volume_size': 1} Apr 14 02:58:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] creating volume v_a83f435c-93f4-418a-b55c-80bcea20a699. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:58:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] create volume {'name': 'v_a83f435c-93f4-418a-b55c-80bcea20a699', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:58:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be17feaa-1eda-4cb8-93d1-7ca391833cc7 tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_3daf5d87-24e6-41c6-bf3c-917855a7dbbf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be17feaa-1eda-4cb8-93d1-7ca391833cc7 tempest-SnapshotsActionsTest-1419620875 None] create volume s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf from snapshot s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:58:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be17feaa-1eda-4cb8-93d1-7ca391833cc7 tempest-SnapshotsActionsTest-1419620875 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be17feaa-1eda-4cb8-93d1-7ca391833cc7 tempest-SnapshotsActionsTest-1419620875 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303832064', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:58:12 user cinder-volume[73403]: DEBUG cinder.manager [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:58:12 user cinder-volume[73403]: INFO cinder.volume.manager [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Deleted volume successfully. Apr 14 02:58:12 user cinder-volume[73403]: DEBUG cinder.coordination [None req-14822b70-5fe7-4ab0-bfc7-76e276bfc85b tempest-VolumesTransfersV355Test-755406959 None] Lock "cinder-4a287afd-8a15-47ce-8be2-1336f169e5ce-delete_volume" released by "delete_volume" :: held 4.379s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be17feaa-1eda-4cb8-93d1-7ca391833cc7 tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ceda750c-3661-4806-9e27-2013edcf9d2f@s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf', 'is_clone': True, 'full_name': 'Pool-0/s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf', 'name': 's_3daf5d87-24e6-41c6-bf3c-917855a7dbbf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be17feaa-1eda-4cb8-93d1-7ca391833cc7 tempest-SnapshotsActionsTest-1419620875 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be17feaa-1eda-4cb8-93d1-7ca391833cc7 tempest-SnapshotsActionsTest-1419620875 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be17feaa-1eda-4cb8-93d1-7ca391833cc7 tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be17feaa-1eda-4cb8-93d1-7ca391833cc7 tempest-SnapshotsActionsTest-1419620875 None] volume s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:58:13 user cinder-volume[73403]: INFO cinder.volume.manager [None req-be17feaa-1eda-4cb8-93d1-7ca391833cc7 tempest-SnapshotsActionsTest-1419620875 None] Create snapshot completed successfully Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Flow 'volume_create_manager' (ec2a3465-f722-45a7-9f9a-f35e0215cda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5261d993-9ba4-41db-99cc-c5ebda3a6dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a83f435c-93f4-418a-b55c-80bcea20a699', 'is_clone': False, 'name': 'v_a83f435c-93f4-418a-b55c-80bcea20a699'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20378f50-ebcb-415d-8814-9427fca8db1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a83f435c-93f4-418a-b55c-80bcea20a699', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8162d4-d703-4f77-a7c0-cc35734e1577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5261d993-9ba4-41db-99cc-c5ebda3a6dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1581610300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e682fdb4-d03c-4407-ac7c-54cdd4f930c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9c6e4d9b634e52be84dd2198c7edb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:58:13Z,use_quota=True,user_id='df67e0fdea154b589565d238d1c457b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b44ea5f-1753-4ac7-b66b-062e37b2023f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b44ea5f-1753-4ac7-b66b-062e37b2023f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d163f7c-a8ba-4be2-8012-d5d2d0545080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d163f7c-a8ba-4be2-8012-d5d2d0545080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e682fdb4-d03c-4407-ac7c-54cdd4f930c0', 'volume_name': 'volume-e682fdb4-d03c-4407-ac7c-54cdd4f930c0', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe49232-bbc1-4247-a380-d111bbfa6998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe49232-bbc1-4247-a380-d111bbfa6998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a7a762-4c44-4fe8-abbc-abfeb5915dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:13 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Volume e682fdb4-d03c-4407-ac7c-54cdd4f930c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e682fdb4-d03c-4407-ac7c-54cdd4f930c0', 'volume_size': 1} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] creating volume v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] create volume {'name': 'v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:13 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Volume volume-a83f435c-93f4-418a-b55c-80bcea20a699 (a83f435c-93f4-418a-b55c-80bcea20a699): created successfully Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8162d4-d703-4f77-a7c0-cc35734e1577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Flow 'volume_create_manager' (799e3c05-254a-44ac-a5c7-e0306c0a2be7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:13 user cinder-volume[73403]: INFO cinder.volume.manager [None req-b46824c1-52b8-472c-a300-14c0de266ecf tempest-VolumesListAdminTestJSON-981052236 None] Created volume successfully. Apr 14 02:58:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0', 'is_clone': False, 'name': 'v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a7a762-4c44-4fe8-abbc-abfeb5915dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e682fdb4-d03c-4407-ac7c-54cdd4f930c0', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e1a42a-3ef5-4107-93aa-65fdfaceca57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:14 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Volume volume-e682fdb4-d03c-4407-ac7c-54cdd4f930c0 (e682fdb4-d03c-4407-ac7c-54cdd4f930c0): created successfully Apr 14 02:58:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e1a42a-3ef5-4107-93aa-65fdfaceca57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Flow 'volume_create_manager' (ec2a3465-f722-45a7-9f9a-f35e0215cda7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:14 user cinder-volume[73403]: INFO cinder.volume.manager [None req-0982439f-488a-42fa-b324-7d3090c4124c tempest-VolumesTransfersV355Test-1318065877 None] Created volume successfully. Apr 14 02:58:15 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:58:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Flow 'volume_create_manager' (bc83324a-301f-4e6a-87ad-4f161bb49c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df576f22-255d-41ee-9ff6-f281b498770e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df576f22-255d-41ee-9ff6-f281b498770e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-482924419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=134c8edd-cf8b-441f-943e-c69438d76a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98467468e2634791b03e7de02104fb6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:58:15Z,use_quota=True,user_id='68d9c00304044e2fa11fbd652a26306f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5afff256-c41f-4243-8c94-7dca83e59258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5afff256-c41f-4243-8c94-7dca83e59258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afa7e605-1250-4b12-96fb-00b568db706d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afa7e605-1250-4b12-96fb-00b568db706d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '134c8edd-cf8b-441f-943e-c69438d76a53', 'volume_name': 'volume-134c8edd-cf8b-441f-943e-c69438d76a53', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99a85a7-e8a3-4c0b-bbdd-1ac8e8a00435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99a85a7-e8a3-4c0b-bbdd-1ac8e8a00435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57128005-8146-4935-ad71-b1d9ef9f281b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:15 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Volume 134c8edd-cf8b-441f-943e-c69438d76a53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-134c8edd-cf8b-441f-943e-c69438d76a53', 'volume_size': 1} Apr 14 02:58:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] creating volume v_134c8edd-cf8b-441f-943e-c69438d76a53. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:58:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] create volume {'name': 'v_134c8edd-cf8b-441f-943e-c69438d76a53', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:58:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24b5fe05-2d31-4432-a1ba-d3bd26ae133f tempest-SnapshotsActionsTest-1419620875 None] create snapshot 3f2f619f-8349-464d-9fca-9521dde1f89b for volume ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:58:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24b5fe05-2d31-4432-a1ba-d3bd26ae133f tempest-SnapshotsActionsTest-1419620875 None] cloning v_ceda750c-3661-4806-9e27-2013edcf9d2f to s_3f2f619f-8349-464d-9fca-9521dde1f89b {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:58:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24b5fe05-2d31-4432-a1ba-d3bd26ae133f tempest-SnapshotsActionsTest-1419620875 None] create snapshot s_3f2f619f-8349-464d-9fca-9521dde1f89b {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:58:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24b5fe05-2d31-4432-a1ba-d3bd26ae133f tempest-SnapshotsActionsTest-1419620875 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24b5fe05-2d31-4432-a1ba-d3bd26ae133f tempest-SnapshotsActionsTest-1419620875 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Acquiring lock "cinder-e682fdb4-d03c-4407-ac7c-54cdd4f930c0-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Lock "cinder-e682fdb4-d03c-4407-ac7c-54cdd4f930c0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] remove_export for volume: e682fdb4-d03c-4407-ac7c-54cdd4f930c0. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1581610300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e682fdb4-d03c-4407-ac7c-54cdd4f930c0,launched_at=2023-04-14T02:58:15Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9c6e4d9b634e52be84dd2198c7edb9',provider_auth='CHAP qKRpumDY wnNHUly0iof48E',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e682fdb4-d03c-4407-ac7c-54cdd4f930c0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:13Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:58:16Z,updated_at=2023-04-14T02:58:16Z,use_quota=True,user_id='df67e0fdea154b589565d238d1c457b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:e682fdb4-d03c-4407-ac7c-54cdd4f930c0. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] detach volume v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0 from target iqn.2010-10.org.openstack:e682fdb4-d03c-4407-ac7c-54cdd4f930c0 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e682fdb4-d03c-4407-ac7c-54cdd4f930c0/luns/v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e682fdb4-d03c-4407-ac7c-54cdd4f930c0/luns/v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e682fdb4-d03c-4407-ac7c-54cdd4f930c0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e682fdb4-d03c-4407-ac7c-54cdd4f930c0/luns/v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e682fdb4-d03c-4407-ac7c-54cdd4f930c0/luns/v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] failed to remove resource iqn.2010-10.org.openstack:e682fdb4-d03c-4407-ac7c-54cdd4f930c0 because of JDSS resource v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] delete target: iqn.2010-10.org.openstack:e682fdb4-d03c-4407-ac7c-54cdd4f930c0 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] delete target iqn.2010-10.org.openstack:e682fdb4-d03c-4407-ac7c-54cdd4f930c0 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e682fdb4-d03c-4407-ac7c-54cdd4f930c0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e682fdb4-d03c-4407-ac7c-54cdd4f930c0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e682fdb4-d03c-4407-ac7c-54cdd4f930c0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e682fdb4-d03c-4407-ac7c-54cdd4f930c0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e682fdb4-d03c-4407-ac7c-54cdd4f930c0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] failed to remove resource iqn.2010-10.org.openstack:e682fdb4-d03c-4407-ac7c-54cdd4f930c0 because of JDSS resource iqn.2010-10.org.openstack:e682fdb4-d03c-4407-ac7c-54cdd4f930c0 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] deleating volume v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] get snapshots for volume v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_134c8edd-cf8b-441f-943e-c69438d76a53', 'is_clone': False, 'name': 'v_134c8edd-cf8b-441f-943e-c69438d76a53'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57128005-8146-4935-ad71-b1d9ef9f281b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-134c8edd-cf8b-441f-943e-c69438d76a53', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68011974-c284-49d7-937f-e317f98d4cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24b5fe05-2d31-4432-a1ba-d3bd26ae133f tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_3f2f619f-8349-464d-9fca-9521dde1f89b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24b5fe05-2d31-4432-a1ba-d3bd26ae133f tempest-SnapshotsActionsTest-1419620875 None] create volume s_3f2f619f-8349-464d-9fca-9521dde1f89b from snapshot s_3f2f619f-8349-464d-9fca-9521dde1f89b {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24b5fe05-2d31-4432-a1ba-d3bd26ae133f tempest-SnapshotsActionsTest-1419620875 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24b5fe05-2d31-4432-a1ba-d3bd26ae133f tempest-SnapshotsActionsTest-1419620875 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:16 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Volume volume-134c8edd-cf8b-441f-943e-c69438d76a53 (134c8edd-cf8b-441f-943e-c69438d76a53): created successfully Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68011974-c284-49d7-937f-e317f98d4cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:16 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Flow 'volume_create_manager' (bc83324a-301f-4e6a-87ad-4f161bb49c7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:16 user cinder-volume[73403]: INFO cinder.volume.manager [None req-ff77460b-83d9-410d-a9ff-4418cccf96da tempest-VolumesListAdminTestJSON-981052236 None] Created volume successfully. Apr 14 02:58:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] get volume v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:58:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442503', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112530', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3410284944160731419', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '33d67890820c21f5', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303524864', 'san:volume_id': '33d67890820c21f5e9ce8fc4822702f093305cb7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83961', 'name': 'v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] delete volume:v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:58:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24b5fe05-2d31-4432-a1ba-d3bd26ae133f tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ceda750c-3661-4806-9e27-2013edcf9d2f@s_3f2f619f-8349-464d-9fca-9521dde1f89b', 'is_clone': True, 'full_name': 'Pool-0/s_3f2f619f-8349-464d-9fca-9521dde1f89b', 'name': 's_3f2f619f-8349-464d-9fca-9521dde1f89b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24b5fe05-2d31-4432-a1ba-d3bd26ae133f tempest-SnapshotsActionsTest-1419620875 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3f2f619f-8349-464d-9fca-9521dde1f89b/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24b5fe05-2d31-4432-a1ba-d3bd26ae133f tempest-SnapshotsActionsTest-1419620875 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3f2f619f-8349-464d-9fca-9521dde1f89b/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24b5fe05-2d31-4432-a1ba-d3bd26ae133f tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3f2f619f-8349-464d-9fca-9521dde1f89b/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24b5fe05-2d31-4432-a1ba-d3bd26ae133f tempest-SnapshotsActionsTest-1419620875 None] volume s_3f2f619f-8349-464d-9fca-9521dde1f89b properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:58:17 user cinder-volume[73403]: INFO cinder.volume.manager [None req-24b5fe05-2d31-4432-a1ba-d3bd26ae133f tempest-SnapshotsActionsTest-1419620875 None] Create snapshot completed successfully Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Flow 'volume_create_manager' (d2d24a3f-0b3b-4b6e-bbd3-8e06601fe844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (643d3d64-fa13-40fb-a9d3-b99490eba7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (643d3d64-fa13-40fb-a9d3-b99490eba7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9472f068-a461-4e27-a089-d50357f4a25f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b7f0015c414f7b90b15f1522b3e790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:58:18Z,use_quota=True,user_id='b50c23cf5ba84838992415bb3c0b509b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a534a3d-c9e0-420d-b9d8-e039e907b179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a534a3d-c9e0-420d-b9d8-e039e907b179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57284d0b-6cae-4d59-a220-3ebbe44accfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57284d0b-6cae-4d59-a220-3ebbe44accfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9472f068-a461-4e27-a089-d50357f4a25f', 'volume_name': 'volume-9472f068-a461-4e27-a089-d50357f4a25f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed280dbf-6357-4d7c-8a76-189f01e8fd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed280dbf-6357-4d7c-8a76-189f01e8fd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1283291-cbd2-4a2b-a33e-8a8cc9636722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:18 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Volume 9472f068-a461-4e27-a089-d50357f4a25f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9472f068-a461-4e27-a089-d50357f4a25f', 'volume_size': 1} Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] creating volume v_9472f068-a461-4e27-a089-d50357f4a25f. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] create volume {'name': 'v_9472f068-a461-4e27-a089-d50357f4a25f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b95b6c8d-e7e8-479f-a6bb-9dc39591b039 tempest-SnapshotsActionsTest-451765625 None] Acquiring lock "cinder-3f2f619f-8349-464d-9fca-9521dde1f89b-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b95b6c8d-e7e8-479f-a6bb-9dc39591b039 tempest-SnapshotsActionsTest-451765625 None] Lock "cinder-3f2f619f-8349-464d-9fca-9521dde1f89b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b95b6c8d-e7e8-479f-a6bb-9dc39591b039 tempest-SnapshotsActionsTest-451765625 None] deleating snapshot s_3f2f619f-8349-464d-9fca-9521dde1f89b. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b95b6c8d-e7e8-479f-a6bb-9dc39591b039 tempest-SnapshotsActionsTest-451765625 None] get snapshots for volume s_3f2f619f-8349-464d-9fca-9521dde1f89b {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95b6c8d-e7e8-479f-a6bb-9dc39591b039 tempest-SnapshotsActionsTest-451765625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3f2f619f-8349-464d-9fca-9521dde1f89b/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95b6c8d-e7e8-479f-a6bb-9dc39591b039 tempest-SnapshotsActionsTest-451765625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3f2f619f-8349-464d-9fca-9521dde1f89b/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] volume v_e682fdb4-d03c-4407-ac7c-54cdd4f930c0 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95b6c8d-e7e8-479f-a6bb-9dc39591b039 tempest-SnapshotsActionsTest-451765625 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3f2f619f-8349-464d-9fca-9521dde1f89b/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b95b6c8d-e7e8-479f-a6bb-9dc39591b039 tempest-SnapshotsActionsTest-451765625 None] get volume s_3f2f619f-8349-464d-9fca-9521dde1f89b info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95b6c8d-e7e8-479f-a6bb-9dc39591b039 tempest-SnapshotsActionsTest-451765625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3f2f619f-8349-464d-9fca-9521dde1f89b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95b6c8d-e7e8-479f-a6bb-9dc39591b039 tempest-SnapshotsActionsTest-451765625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3f2f619f-8349-464d-9fca-9521dde1f89b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.quota [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Created reservations ['716ec26d-dc63-42c4-9035-4244135eea45', '3f4a55ec-ec92-4715-bf7f-981fd26fb754', 'fc6a55c8-ba9c-4fa0-b434-ebd6cc671301', 'b79b7759-97c6-40af-b02a-56114193107f'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95b6c8d-e7e8-479f-a6bb-9dc39591b039 tempest-SnapshotsActionsTest-451765625 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ceda750c-3661-4806-9e27-2013edcf9d2f@s_3f2f619f-8349-464d-9fca-9521dde1f89b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_3f2f619f-8349-464d-9fca-9521dde1f89b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442505', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112540', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11983834986286154343', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '421be350f334c5e3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303549440', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85134', 'name': 's_3f2f619f-8349-464d-9fca-9521dde1f89b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3f2f619f-8349-464d-9fca-9521dde1f89b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b95b6c8d-e7e8-479f-a6bb-9dc39591b039 tempest-SnapshotsActionsTest-451765625 None] delete snapshot s_3f2f619f-8349-464d-9fca-9521dde1f89b of volume v_ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95b6c8d-e7e8-479f-a6bb-9dc39591b039 tempest-SnapshotsActionsTest-451765625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots/s_3f2f619f-8349-464d-9fca-9521dde1f89b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95b6c8d-e7e8-479f-a6bb-9dc39591b039 tempest-SnapshotsActionsTest-451765625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots/s_3f2f619f-8349-464d-9fca-9521dde1f89b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=60,cinder:UPDATE=33,cinder:DELETE=3,cinder:INSERT=4 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Flow 'volume_create_manager' (97a2ff59-9d9d-40fb-8bd1-c9b0608fbbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42eafd3c-4eb0-4f9e-ad95-ee871fdb102b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42eafd3c-4eb0-4f9e-ad95-ee871fdb102b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1840409834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=45e86581-88e9-4ace-b9df-10ddbc786335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71e39d23c69541d09fe3f89bc0b20a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:58:20Z,use_quota=True,user_id='72ecb8d5049842ee801fc8ea5f83428a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32012637-4bbf-4cf4-9d61-5f9b341d4fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32012637-4bbf-4cf4-9d61-5f9b341d4fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f3c09e-f1f0-49d4-abb1-fee93a7bb14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9472f068-a461-4e27-a089-d50357f4a25f', 'is_clone': False, 'name': 'v_9472f068-a461-4e27-a089-d50357f4a25f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1283291-cbd2-4a2b-a33e-8a8cc9636722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9472f068-a461-4e27-a089-d50357f4a25f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4bcc517-a82e-484c-be02-51708ba807bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:19 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Volume volume-9472f068-a461-4e27-a089-d50357f4a25f (9472f068-a461-4e27-a089-d50357f4a25f): created successfully Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4bcc517-a82e-484c-be02-51708ba807bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Flow 'volume_create_manager' (d2d24a3f-0b3b-4b6e-bbd3-8e06601fe844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:19 user cinder-volume[73403]: INFO cinder.volume.manager [None req-598139ef-c923-471a-9fd8-1e6a18980a9c tempest-VolumesListAdminTestJSON-1809829196 None] Created volume successfully. Apr 14 02:58:20 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f3c09e-f1f0-49d4-abb1-fee93a7bb14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '45e86581-88e9-4ace-b9df-10ddbc786335', 'volume_name': 'volume-45e86581-88e9-4ace-b9df-10ddbc786335', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:20 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9c97d3-11f0-4575-89d5-d6f0b287418e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:20 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9c97d3-11f0-4575-89d5-d6f0b287418e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:20 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2bc0364-fdc8-47b3-b127-e808aec0a1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:20 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Volume 45e86581-88e9-4ace-b9df-10ddbc786335: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-45e86581-88e9-4ace-b9df-10ddbc786335', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 02:58:20 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Cloning 45e86581-88e9-4ace-b9df-10ddbc786335 from image 98e6a247-250b-4bb5-a947-e7f93598d16e at location (None, None). {{(pid=73403) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 02:58:20 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Acquiring lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" by "_prepare_image_cache_entry" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:58:20 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:58:20 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Preparing cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:891}} Apr 14 02:58:20 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Attempting to retrieve cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 02:58:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303524864', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:58:20 user cinder-volume[73403]: DEBUG cinder.manager [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:58:20 user cinder-volume[73403]: INFO cinder.volume.manager [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Deleted volume successfully. Apr 14 02:58:20 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c6819f4e-aaaf-4af5-90ca-328be31abbe1 tempest-VolumesTransfersV355Test-755406959 None] Lock "cinder-e682fdb4-d03c-4407-ac7c-54cdd4f930c0-delete_volume" released by "delete_volume" :: held 4.449s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:58:20 user cinder-volume[73403]: DEBUG cinder.coordination [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Acquiring lock "cinder-9472f068-a461-4e27-a089-d50357f4a25f-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:58:20 user cinder-volume[73403]: DEBUG cinder.coordination [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Lock "cinder-9472f068-a461-4e27-a089-d50357f4a25f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] remove_export for volume: 9472f068-a461-4e27-a089-d50357f4a25f. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9472f068-a461-4e27-a089-d50357f4a25f,launched_at=2023-04-14T02:58:20Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b7f0015c414f7b90b15f1522b3e790',provider_auth='CHAP PFmyEZbf fHxN9eIhcgOioz',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9472f068-a461-4e27-a089-d50357f4a25f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:18Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:58:21Z,updated_at=2023-04-14T02:58:21Z,use_quota=True,user_id='b50c23cf5ba84838992415bb3c0b509b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:9472f068-a461-4e27-a089-d50357f4a25f. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] detach volume v_9472f068-a461-4e27-a089-d50357f4a25f from target iqn.2010-10.org.openstack:9472f068-a461-4e27-a089-d50357f4a25f {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9472f068-a461-4e27-a089-d50357f4a25f/luns/v_9472f068-a461-4e27-a089-d50357f4a25f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9472f068-a461-4e27-a089-d50357f4a25f/luns/v_9472f068-a461-4e27-a089-d50357f4a25f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9472f068-a461-4e27-a089-d50357f4a25f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9472f068-a461-4e27-a089-d50357f4a25f/luns/v_9472f068-a461-4e27-a089-d50357f4a25f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9472f068-a461-4e27-a089-d50357f4a25f/luns/v_9472f068-a461-4e27-a089-d50357f4a25f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] failed to remove resource iqn.2010-10.org.openstack:9472f068-a461-4e27-a089-d50357f4a25f because of JDSS resource v_9472f068-a461-4e27-a089-d50357f4a25f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] delete target: iqn.2010-10.org.openstack:9472f068-a461-4e27-a089-d50357f4a25f {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] delete target iqn.2010-10.org.openstack:9472f068-a461-4e27-a089-d50357f4a25f {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9472f068-a461-4e27-a089-d50357f4a25f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9472f068-a461-4e27-a089-d50357f4a25f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9472f068-a461-4e27-a089-d50357f4a25f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9472f068-a461-4e27-a089-d50357f4a25f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9472f068-a461-4e27-a089-d50357f4a25f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] failed to remove resource iqn.2010-10.org.openstack:9472f068-a461-4e27-a089-d50357f4a25f because of JDSS resource iqn.2010-10.org.openstack:9472f068-a461-4e27-a089-d50357f4a25f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] deleating volume v_9472f068-a461-4e27-a089-d50357f4a25f {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] get snapshots for volume v_9472f068-a461-4e27-a089-d50357f4a25f {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9472f068-a461-4e27-a089-d50357f4a25f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9472f068-a461-4e27-a089-d50357f4a25f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Acquiring lock "cinder-134c8edd-cf8b-441f-943e-c69438d76a53-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.image.image_utils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_98e6a247-250b-4bb5-a947-e7f93598d16e_pcfd_1ntuser@joviandss-2, size 15.55 MB, duration 1.00 sec {{(pid=73403) fetch /opt/stack/cinder/cinder/image/image_utils.py:628}} Apr 14 02:58:21 user cinder-volume[73403]: INFO cinder.image.image_utils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Image download 15.55 MB at 15.55 MB/s Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Lock "cinder-134c8edd-cf8b-441f-943e-c69438d76a53-delete_volume" acquired by "delete_volume" :: waited 0.164s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] remove_export for volume: 134c8edd-cf8b-441f-943e-c69438d76a53. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-482924419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=134c8edd-cf8b-441f-943e-c69438d76a53,launched_at=2023-04-14T02:58:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98467468e2634791b03e7de02104fb6c',provider_auth='CHAP VzxWkNHS rLJ5dunlixjoh9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:134c8edd-cf8b-441f-943e-c69438d76a53 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:15Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:58:21Z,updated_at=2023-04-14T02:58:21Z,use_quota=True,user_id='68d9c00304044e2fa11fbd652a26306f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:134c8edd-cf8b-441f-943e-c69438d76a53. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] detach volume v_134c8edd-cf8b-441f-943e-c69438d76a53 from target iqn.2010-10.org.openstack:134c8edd-cf8b-441f-943e-c69438d76a53 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:134c8edd-cf8b-441f-943e-c69438d76a53/luns/v_134c8edd-cf8b-441f-943e-c69438d76a53 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:134c8edd-cf8b-441f-943e-c69438d76a53/luns/v_134c8edd-cf8b-441f-943e-c69438d76a53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_98e6a247-250b-4bb5-a947-e7f93598d16e_pcfd_1ntuser@joviandss-2 {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:134c8edd-cf8b-441f-943e-c69438d76a53 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:134c8edd-cf8b-441f-943e-c69438d76a53/luns/v_134c8edd-cf8b-441f-943e-c69438d76a53'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:134c8edd-cf8b-441f-943e-c69438d76a53/luns/v_134c8edd-cf8b-441f-943e-c69438d76a53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] failed to remove resource iqn.2010-10.org.openstack:134c8edd-cf8b-441f-943e-c69438d76a53 because of JDSS resource v_134c8edd-cf8b-441f-943e-c69438d76a53 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] delete target: iqn.2010-10.org.openstack:134c8edd-cf8b-441f-943e-c69438d76a53 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] delete target iqn.2010-10.org.openstack:134c8edd-cf8b-441f-943e-c69438d76a53 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:134c8edd-cf8b-441f-943e-c69438d76a53 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:134c8edd-cf8b-441f-943e-c69438d76a53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95b6c8d-e7e8-479f-a6bb-9dc39591b039 tempest-SnapshotsActionsTest-451765625 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots/s_3f2f619f-8349-464d-9fca-9521dde1f89b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b95b6c8d-e7e8-479f-a6bb-9dc39591b039 tempest-SnapshotsActionsTest-451765625 None] snapshot s_3f2f619f-8349-464d-9fca-9521dde1f89b deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=62,cinder:UPDATE=28,cinder:INSERT=4,cinder:DELETE=6 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:134c8edd-cf8b-441f-943e-c69438d76a53 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:134c8edd-cf8b-441f-943e-c69438d76a53'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:134c8edd-cf8b-441f-943e-c69438d76a53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] failed to remove resource iqn.2010-10.org.openstack:134c8edd-cf8b-441f-943e-c69438d76a53 because of JDSS resource iqn.2010-10.org.openstack:134c8edd-cf8b-441f-943e-c69438d76a53 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] deleating volume v_134c8edd-cf8b-441f-943e-c69438d76a53 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] get snapshots for volume v_134c8edd-cf8b-441f-943e-c69438d76a53 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_134c8edd-cf8b-441f-943e-c69438d76a53/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_134c8edd-cf8b-441f-943e-c69438d76a53/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.quota [None req-b95b6c8d-e7e8-479f-a6bb-9dc39591b039 tempest-SnapshotsActionsTest-451765625 None] Created reservations ['e2e3288d-1df2-4cbc-b1bf-4f475420353c', '8566e5d0-a911-42dd-9ddc-1e1fe4878993', '3249c346-4b90-4699-83a8-61a3d1a094fa', '563e2c19-be34-4526-b0ff-86ba246c9c40'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:21 user sudo[80987]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_98e6a247-250b-4bb5-a947-e7f93598d16e_pcfd_1ntuser@joviandss-2 Apr 14 02:58:21 user sudo[80987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 02:58:21 user cinder-volume[73403]: INFO cinder.volume.manager [None req-b95b6c8d-e7e8-479f-a6bb-9dc39591b039 tempest-SnapshotsActionsTest-451765625 None] Delete snapshot completed successfully. Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b95b6c8d-e7e8-479f-a6bb-9dc39591b039 tempest-SnapshotsActionsTest-451765625 None] Lock "cinder-3f2f619f-8349-464d-9fca-9521dde1f89b-delete_snapshot" released by "delete_snapshot" :: held 3.033s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9472f068-a461-4e27-a089-d50357f4a25f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] get volume v_9472f068-a461-4e27-a089-d50357f4a25f info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9472f068-a461-4e27-a089-d50357f4a25f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9472f068-a461-4e27-a089-d50357f4a25f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9472f068-a461-4e27-a089-d50357f4a25f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442508', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112545', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10942195258940312683', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a855dfda36b8e0d4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303549440', 'san:volume_id': 'a855dfda36b8e0d444183cab2e3778ef6a36a93e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85147', 'name': 'v_9472f068-a461-4e27-a089-d50357f4a25f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9472f068-a461-4e27-a089-d50357f4a25f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] delete volume:v_9472f068-a461-4e27-a089-d50357f4a25f recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9472f068-a461-4e27-a089-d50357f4a25f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9472f068-a461-4e27-a089-d50357f4a25f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_134c8edd-cf8b-441f-943e-c69438d76a53/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] get volume v_134c8edd-cf8b-441f-943e-c69438d76a53 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:58:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_134c8edd-cf8b-441f-943e-c69438d76a53 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_134c8edd-cf8b-441f-943e-c69438d76a53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_134c8edd-cf8b-441f-943e-c69438d76a53', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442505', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112535', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5257586194350963706', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6f019cc7a8294da1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303549440', 'san:volume_id': '6f019cc7a8294da1ed12d21358f1c44269f287ea', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85123', 'name': 'v_134c8edd-cf8b-441f-943e-c69438d76a53', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_134c8edd-cf8b-441f-943e-c69438d76a53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] delete volume:v_134c8edd-cf8b-441f-943e-c69438d76a53 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:58:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_134c8edd-cf8b-441f-943e-c69438d76a53 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_134c8edd-cf8b-441f-943e-c69438d76a53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77b137fb-c673-4bb8-a1a9-5a11e748dc55 tempest-SnapshotsActionsTest-1419620875 None] create snapshot 39a77c77-6449-4785-a993-5964fc81c6c4 for volume ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:58:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77b137fb-c673-4bb8-a1a9-5a11e748dc55 tempest-SnapshotsActionsTest-1419620875 None] cloning v_ceda750c-3661-4806-9e27-2013edcf9d2f to s_39a77c77-6449-4785-a993-5964fc81c6c4 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:58:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77b137fb-c673-4bb8-a1a9-5a11e748dc55 tempest-SnapshotsActionsTest-1419620875 None] create snapshot s_39a77c77-6449-4785-a993-5964fc81c6c4 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:58:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77b137fb-c673-4bb8-a1a9-5a11e748dc55 tempest-SnapshotsActionsTest-1419620875 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77b137fb-c673-4bb8-a1a9-5a11e748dc55 tempest-SnapshotsActionsTest-1419620875 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:23 user sudo[80987]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:23 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_98e6a247-250b-4bb5-a947-e7f93598d16e_pcfd_1ntuser@joviandss-2" returned: 0 in 1.570s {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:23 user cinder-volume[73403]: DEBUG cinder.image.image_utils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Temporary image 98e6a247-250b-4bb5-a947-e7f93598d16e is fetched for user 72ecb8d5049842ee801fc8ea5f83428a. {{(pid=73403) fetch /opt/stack/cinder/cinder/image/image_utils.py:1279}} Apr 14 02:58:23 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_98e6a247-250b-4bb5-a947-e7f93598d16e_pcfd_1ntuser@joviandss-2 {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:23 user sudo[81024]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_98e6a247-250b-4bb5-a947-e7f93598d16e_pcfd_1ntuser@joviandss-2 Apr 14 02:58:23 user sudo[81024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 02:58:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77b137fb-c673-4bb8-a1a9-5a11e748dc55 tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_39a77c77-6449-4785-a993-5964fc81c6c4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77b137fb-c673-4bb8-a1a9-5a11e748dc55 tempest-SnapshotsActionsTest-1419620875 None] create volume s_39a77c77-6449-4785-a993-5964fc81c6c4 from snapshot s_39a77c77-6449-4785-a993-5964fc81c6c4 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:58:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77b137fb-c673-4bb8-a1a9-5a11e748dc55 tempest-SnapshotsActionsTest-1419620875 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77b137fb-c673-4bb8-a1a9-5a11e748dc55 tempest-SnapshotsActionsTest-1419620875 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9472f068-a461-4e27-a089-d50357f4a25f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] volume v_9472f068-a461-4e27-a089-d50357f4a25f deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:58:24 user cinder-volume[73403]: DEBUG cinder.quota [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Created reservations ['a7bd05ef-297e-4479-88fc-5e40a407c7da', 'e1c86fc6-3851-4994-af21-e5235aa975c9', '2cf33f1e-9833-428e-ae40-59d320b4c603', '4feb0a61-2871-49cb-b275-9a13d4e9037e'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:58:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:58:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:24 user sudo[81024]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:24 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_98e6a247-250b-4bb5-a947-e7f93598d16e_pcfd_1ntuser@joviandss-2" returned: 0 in 1.228s {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] creating volume v_45e86581-88e9-4ace-b9df-10ddbc786335. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:58:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] create volume {'name': 'v_45e86581-88e9-4ace-b9df-10ddbc786335', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:58:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77b137fb-c673-4bb8-a1a9-5a11e748dc55 tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ceda750c-3661-4806-9e27-2013edcf9d2f@s_39a77c77-6449-4785-a993-5964fc81c6c4', 'is_clone': True, 'full_name': 'Pool-0/s_39a77c77-6449-4785-a993-5964fc81c6c4', 'name': 's_39a77c77-6449-4785-a993-5964fc81c6c4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77b137fb-c673-4bb8-a1a9-5a11e748dc55 tempest-SnapshotsActionsTest-1419620875 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_39a77c77-6449-4785-a993-5964fc81c6c4/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77b137fb-c673-4bb8-a1a9-5a11e748dc55 tempest-SnapshotsActionsTest-1419620875 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_39a77c77-6449-4785-a993-5964fc81c6c4/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_134c8edd-cf8b-441f-943e-c69438d76a53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] volume v_134c8edd-cf8b-441f-943e-c69438d76a53 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:58:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77b137fb-c673-4bb8-a1a9-5a11e748dc55 tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_39a77c77-6449-4785-a993-5964fc81c6c4/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77b137fb-c673-4bb8-a1a9-5a11e748dc55 tempest-SnapshotsActionsTest-1419620875 None] volume s_39a77c77-6449-4785-a993-5964fc81c6c4 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:58:25 user cinder-volume[73403]: INFO cinder.volume.manager [None req-77b137fb-c673-4bb8-a1a9-5a11e748dc55 tempest-SnapshotsActionsTest-1419620875 None] Create snapshot completed successfully Apr 14 02:58:25 user cinder-volume[73403]: DEBUG cinder.quota [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Created reservations ['94a961a1-ce51-4fd3-84d8-c71ca52479ef', '472d9b74-6a19-44f1-a98a-9352046a13bb', '91f21cf6-6d26-48de-aa19-f2ca6bd22861', 'a2457d88-42a3-4ebc-a977-e480b0cb2c58'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303688704', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:58:25 user cinder-volume[73403]: DEBUG cinder.manager [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:58:25 user cinder-volume[73403]: INFO cinder.volume.manager [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Deleted volume successfully. Apr 14 02:58:25 user cinder-volume[73403]: DEBUG cinder.coordination [None req-59339036-ee15-467b-bf52-a76bc99c2a8c tempest-VolumesListAdminTestJSON-1809829196 None] Lock "cinder-9472f068-a461-4e27-a089-d50357f4a25f-delete_volume" released by "delete_volume" :: held 4.600s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:58:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:58:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:58:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_45e86581-88e9-4ace-b9df-10ddbc786335', 'is_clone': False, 'name': 'v_45e86581-88e9-4ace-b9df-10ddbc786335'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:25 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Attempting download of 98e6a247-250b-4bb5-a947-e7f93598d16e ((None, None)) to volume 45e86581-88e9-4ace-b9df-10ddbc786335. {{(pid=73403) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Apr 14 02:58:25 user cinder-volume[73403]: DEBUG cinder.volume.driver [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] copy_image_to_volume volume-45e86581-88e9-4ace-b9df-10ddbc786335. {{(pid=73403) _copy_image_data_to_volume /opt/stack/cinder/cinder/volume/driver.py:890}} Apr 14 02:58:25 user cinder-volume[73403]: DEBUG os_brick.utils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=73403) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 02:58:25 user cinder-volume[73403]: INFO oslo.privsep.daemon [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp8y3y0lvl/privsep.sock'] Apr 14 02:58:25 user sudo[81122]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp8y3y0lvl/privsep.sock Apr 14 02:58:25 user sudo[81122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Acquiring lock "cinder-a83f435c-93f4-418a-b55c-80bcea20a699-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Lock "cinder-a83f435c-93f4-418a-b55c-80bcea20a699-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.coordination [None req-50546ee5-a2ae-45df-9de2-cb9c63544143 tempest-SnapshotsActionsTest-451765625 None] Acquiring lock "cinder-39a77c77-6449-4785-a993-5964fc81c6c4-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.coordination [None req-50546ee5-a2ae-45df-9de2-cb9c63544143 tempest-SnapshotsActionsTest-451765625 None] Lock "cinder-39a77c77-6449-4785-a993-5964fc81c6c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-50546ee5-a2ae-45df-9de2-cb9c63544143 tempest-SnapshotsActionsTest-451765625 None] deleating snapshot s_39a77c77-6449-4785-a993-5964fc81c6c4. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-50546ee5-a2ae-45df-9de2-cb9c63544143 tempest-SnapshotsActionsTest-451765625 None] get snapshots for volume s_39a77c77-6449-4785-a993-5964fc81c6c4 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50546ee5-a2ae-45df-9de2-cb9c63544143 tempest-SnapshotsActionsTest-451765625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_39a77c77-6449-4785-a993-5964fc81c6c4/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50546ee5-a2ae-45df-9de2-cb9c63544143 tempest-SnapshotsActionsTest-451765625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_39a77c77-6449-4785-a993-5964fc81c6c4/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] remove_export for volume: a83f435c-93f4-418a-b55c-80bcea20a699. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1529042904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a83f435c-93f4-418a-b55c-80bcea20a699,launched_at=2023-04-14T02:58:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98467468e2634791b03e7de02104fb6c',provider_auth='CHAP mhnToXVg PFpw9t0bgHI5NO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a83f435c-93f4-418a-b55c-80bcea20a699 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:12Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:58:26Z,updated_at=2023-04-14T02:58:26Z,use_quota=True,user_id='68d9c00304044e2fa11fbd652a26306f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:a83f435c-93f4-418a-b55c-80bcea20a699. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] detach volume v_a83f435c-93f4-418a-b55c-80bcea20a699 from target iqn.2010-10.org.openstack:a83f435c-93f4-418a-b55c-80bcea20a699 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a83f435c-93f4-418a-b55c-80bcea20a699/luns/v_a83f435c-93f4-418a-b55c-80bcea20a699 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a83f435c-93f4-418a-b55c-80bcea20a699/luns/v_a83f435c-93f4-418a-b55c-80bcea20a699 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a83f435c-93f4-418a-b55c-80bcea20a699 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a83f435c-93f4-418a-b55c-80bcea20a699/luns/v_a83f435c-93f4-418a-b55c-80bcea20a699'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a83f435c-93f4-418a-b55c-80bcea20a699/luns/v_a83f435c-93f4-418a-b55c-80bcea20a699 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] failed to remove resource iqn.2010-10.org.openstack:a83f435c-93f4-418a-b55c-80bcea20a699 because of JDSS resource v_a83f435c-93f4-418a-b55c-80bcea20a699 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] delete target: iqn.2010-10.org.openstack:a83f435c-93f4-418a-b55c-80bcea20a699 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] delete target iqn.2010-10.org.openstack:a83f435c-93f4-418a-b55c-80bcea20a699 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a83f435c-93f4-418a-b55c-80bcea20a699 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a83f435c-93f4-418a-b55c-80bcea20a699 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a83f435c-93f4-418a-b55c-80bcea20a699 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a83f435c-93f4-418a-b55c-80bcea20a699'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a83f435c-93f4-418a-b55c-80bcea20a699 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] failed to remove resource iqn.2010-10.org.openstack:a83f435c-93f4-418a-b55c-80bcea20a699 because of JDSS resource iqn.2010-10.org.openstack:a83f435c-93f4-418a-b55c-80bcea20a699 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] deleating volume v_a83f435c-93f4-418a-b55c-80bcea20a699 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] get snapshots for volume v_a83f435c-93f4-418a-b55c-80bcea20a699 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a83f435c-93f4-418a-b55c-80bcea20a699/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a83f435c-93f4-418a-b55c-80bcea20a699/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303619072', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.manager [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:58:26 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Deleted volume successfully. Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8e3df222-c690-483d-b61f-4c54e52fe5c4 tempest-VolumesListAdminTestJSON-981052236 None] Lock "cinder-134c8edd-cf8b-441f-943e-c69438d76a53-delete_volume" released by "delete_volume" :: held 5.275s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50546ee5-a2ae-45df-9de2-cb9c63544143 tempest-SnapshotsActionsTest-451765625 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_39a77c77-6449-4785-a993-5964fc81c6c4/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-50546ee5-a2ae-45df-9de2-cb9c63544143 tempest-SnapshotsActionsTest-451765625 None] get volume s_39a77c77-6449-4785-a993-5964fc81c6c4 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50546ee5-a2ae-45df-9de2-cb9c63544143 tempest-SnapshotsActionsTest-451765625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_39a77c77-6449-4785-a993-5964fc81c6c4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50546ee5-a2ae-45df-9de2-cb9c63544143 tempest-SnapshotsActionsTest-451765625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_39a77c77-6449-4785-a993-5964fc81c6c4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a83f435c-93f4-418a-b55c-80bcea20a699/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] get volume v_a83f435c-93f4-418a-b55c-80bcea20a699 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a83f435c-93f4-418a-b55c-80bcea20a699 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a83f435c-93f4-418a-b55c-80bcea20a699 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a83f435c-93f4-418a-b55c-80bcea20a699', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442501', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112525', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9550636671525433911', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b0fe678d83b4dece', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303606784', 'san:volume_id': 'b0fe678d83b4dece4067f65d6a95962597dd561e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '83142', 'name': 'v_a83f435c-93f4-418a-b55c-80bcea20a699', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a83f435c-93f4-418a-b55c-80bcea20a699 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] delete volume:v_a83f435c-93f4-418a-b55c-80bcea20a699 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a83f435c-93f4-418a-b55c-80bcea20a699 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a83f435c-93f4-418a-b55c-80bcea20a699 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50546ee5-a2ae-45df-9de2-cb9c63544143 tempest-SnapshotsActionsTest-451765625 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ceda750c-3661-4806-9e27-2013edcf9d2f@s_39a77c77-6449-4785-a993-5964fc81c6c4', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_39a77c77-6449-4785-a993-5964fc81c6c4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442513', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112557', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4838909998959374320', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3caf0229ec6d81d6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303606784', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85167', 'name': 's_39a77c77-6449-4785-a993-5964fc81c6c4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_39a77c77-6449-4785-a993-5964fc81c6c4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-50546ee5-a2ae-45df-9de2-cb9c63544143 tempest-SnapshotsActionsTest-451765625 None] delete snapshot s_39a77c77-6449-4785-a993-5964fc81c6c4 of volume v_ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:58:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50546ee5-a2ae-45df-9de2-cb9c63544143 tempest-SnapshotsActionsTest-451765625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots/s_39a77c77-6449-4785-a993-5964fc81c6c4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50546ee5-a2ae-45df-9de2-cb9c63544143 tempest-SnapshotsActionsTest-451765625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots/s_39a77c77-6449-4785-a993-5964fc81c6c4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:28 user sudo[81122]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:28 user cinder-volume[73403]: INFO oslo.privsep.daemon [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Spawned new privsep daemon via rootwrap Apr 14 02:58:28 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Accepted privsep connection to /tmp/tmp8y3y0lvl/privsep.sock {{(pid=73403) __init__ /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:362}} Apr 14 02:58:28 user cinder-volume[73403]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 14 02:58:28 user cinder-volume[73403]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 14 02:58:28 user cinder-volume[73403]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none Apr 14 02:58:28 user cinder-volume[73403]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81139 Apr 14 02:58:28 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[2854e380-df43-4a52-9ef5-a37dbdbc22d0]: (2,) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bb47b5-968d-42de-9fc8-20c73f594915]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e1198c5ebb57\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:28 user cinder-volume[73403]: WARNING os_brick.initiator.connectors.nvmeof [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath' Apr 14 02:58:28 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.040s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d0a1fd-28c3-451c-9e9e-d4a9592fa322]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e681863-1eef-4602-b1c8-1e38d1145a5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14e1bb5-6969-4971-a1cf-3fc64f7be094]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Running cmd (subprocess): nvme version {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] 'nvme version' failed. Not Retrying. {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] nvme not present on system {{(pid=73403) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 02:58:28 user cinder-volume[73403]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Apr 14 02:58:28 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[3047c16e-7926-4c99-a83f-8043854e6ae0]: (4, '') {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.lightos [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73403) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.lightos [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73403) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.lightos [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] LIGHTOS: no hostnqn found. {{(pid=73403) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG os_brick.utils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] <== get_connector_properties: return (2872ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e1198c5ebb57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73403) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG cinder.volume.driver [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Volume 45e86581-88e9-4ace-b9df-10ddbc786335: creating export {{(pid=73403) _attach_volume /opt/stack/cinder/cinder/volume/driver.py:1051}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] create export for volume: 45e86581-88e9-4ace-b9df-10ddbc786335. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] ensure volume 45e86581-88e9-4ace-b9df-10ddbc786335 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] check if targe iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] create target and attach volume 45e86581-88e9-4ace-b9df-10ddbc786335 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] create target iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-50546ee5-a2ae-45df-9de2-cb9c63544143 tempest-SnapshotsActionsTest-451765625 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots/s_39a77c77-6449-4785-a993-5964fc81c6c4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-50546ee5-a2ae-45df-9de2-cb9c63544143 tempest-SnapshotsActionsTest-451765625 None] snapshot s_39a77c77-6449-4785-a993-5964fc81c6c4 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a83f435c-93f4-418a-b55c-80bcea20a699 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] volume v_a83f435c-93f4-418a-b55c-80bcea20a699 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=61,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=6 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.quota [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Created reservations ['f6114658-1d5b-498e-bfc5-8f7aadd59532', '89647d6e-1cc5-467f-a45b-ee0c00ccda7c', '63c2d822-409e-4a90-9ff0-ed46f3142511', '3f3d6e7d-2047-456d-ad26-34bd23aa47fe'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.quota [None req-50546ee5-a2ae-45df-9de2-cb9c63544143 tempest-SnapshotsActionsTest-451765625 None] Created reservations ['37f24e30-8483-4199-be7f-ff52f25c2657', '14db6cb2-f8a3-47f9-8ae3-8f2a664fea6b', '4479beea-b216-4066-adeb-0b3080c70ce5', '9a50ea2b-0ea5-4405-8139-0a137cf685ca'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=52,cinder:INSERT=14,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:29 user cinder-volume[73403]: INFO cinder.volume.manager [None req-50546ee5-a2ae-45df-9de2-cb9c63544143 tempest-SnapshotsActionsTest-451765625 None] Delete snapshot completed successfully. Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.coordination [None req-50546ee5-a2ae-45df-9de2-cb9c63544143 tempest-SnapshotsActionsTest-451765625 None] Lock "cinder-39a77c77-6449-4785-a993-5964fc81c6c4-delete_snapshot" released by "delete_snapshot" :: held 3.147s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.coordination [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Acquiring lock "cinder-d20887d3-f55a-457c-bd6d-70d093474f9c-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.coordination [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Lock "cinder-d20887d3-f55a-457c-bd6d-70d093474f9c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] remove_export for volume: d20887d3-f55a-457c-bd6d-70d093474f9c. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2038217980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d20887d3-f55a-457c-bd6d-70d093474f9c,launched_at=2023-04-14T02:58:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98467468e2634791b03e7de02104fb6c',provider_auth='CHAP chljVXws t1jZcGT7kvPDOb',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20887d3-f55a-457c-bd6d-70d093474f9c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:09Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:58:30Z,updated_at=2023-04-14T02:58:30Z,use_quota=True,user_id='68d9c00304044e2fa11fbd652a26306f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:d20887d3-f55a-457c-bd6d-70d093474f9c. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] detach volume v_d20887d3-f55a-457c-bd6d-70d093474f9c from target iqn.2010-10.org.openstack:d20887d3-f55a-457c-bd6d-70d093474f9c {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d20887d3-f55a-457c-bd6d-70d093474f9c/luns/v_d20887d3-f55a-457c-bd6d-70d093474f9c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d20887d3-f55a-457c-bd6d-70d093474f9c/luns/v_d20887d3-f55a-457c-bd6d-70d093474f9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d20887d3-f55a-457c-bd6d-70d093474f9c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d20887d3-f55a-457c-bd6d-70d093474f9c/luns/v_d20887d3-f55a-457c-bd6d-70d093474f9c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d20887d3-f55a-457c-bd6d-70d093474f9c/luns/v_d20887d3-f55a-457c-bd6d-70d093474f9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] failed to remove resource iqn.2010-10.org.openstack:d20887d3-f55a-457c-bd6d-70d093474f9c because of JDSS resource v_d20887d3-f55a-457c-bd6d-70d093474f9c DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] delete target: iqn.2010-10.org.openstack:d20887d3-f55a-457c-bd6d-70d093474f9c {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] delete target iqn.2010-10.org.openstack:d20887d3-f55a-457c-bd6d-70d093474f9c {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d20887d3-f55a-457c-bd6d-70d093474f9c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d20887d3-f55a-457c-bd6d-70d093474f9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d20887d3-f55a-457c-bd6d-70d093474f9c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d20887d3-f55a-457c-bd6d-70d093474f9c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d20887d3-f55a-457c-bd6d-70d093474f9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] failed to remove resource iqn.2010-10.org.openstack:d20887d3-f55a-457c-bd6d-70d093474f9c because of JDSS resource iqn.2010-10.org.openstack:d20887d3-f55a-457c-bd6d-70d093474f9c DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] deleating volume v_d20887d3-f55a-457c-bd6d-70d093474f9c {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] get snapshots for volume v_d20887d3-f55a-457c-bd6d-70d093474f9c {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d20887d3-f55a-457c-bd6d-70d093474f9c/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d20887d3-f55a-457c-bd6d-70d093474f9c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Flow 'volume_create_manager' (7c980e42-2ebe-4f7e-80ce-51d93c1e0043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea9cbf9-d6bd-48bb-a931-6be63976b4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea9cbf9-d6bd-48bb-a931-6be63976b4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-983686268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e1831ff0-b0ca-4aff-844b-4347d1c326da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb76473b77e4b15b46580fa5d5d520b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:58:30Z,use_quota=True,user_id='06244553cd11445084ba0bdb03929f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d47e856-ab6c-45fd-9c9c-eddeb374d4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d47e856-ab6c-45fd-9c9c-eddeb374d4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (debdb9fc-9428-42a8-b6c0-ba0cd20af552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76249218-28ed-476b-91d3-65d84708b0af tempest-SnapshotsActionsTest-1419620875 None] create snapshot db968b95-67c9-477c-832e-7fb32253c074 for volume ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76249218-28ed-476b-91d3-65d84708b0af tempest-SnapshotsActionsTest-1419620875 None] cloning v_ceda750c-3661-4806-9e27-2013edcf9d2f to s_db968b95-67c9-477c-832e-7fb32253c074 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-76249218-28ed-476b-91d3-65d84708b0af tempest-SnapshotsActionsTest-1419620875 None] create snapshot s_db968b95-67c9-477c-832e-7fb32253c074 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76249218-28ed-476b-91d3-65d84708b0af tempest-SnapshotsActionsTest-1419620875 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76249218-28ed-476b-91d3-65d84708b0af tempest-SnapshotsActionsTest-1419620875 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303700992', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.manager [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:58:30 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Deleted volume successfully. Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8daacc6e-067c-4e70-b6eb-1d5fcd978ac0 tempest-VolumesListAdminTestJSON-981052236 None] Lock "cinder-a83f435c-93f4-418a-b55c-80bcea20a699-delete_volume" released by "delete_volume" :: held 4.170s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (debdb9fc-9428-42a8-b6c0-ba0cd20af552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e1831ff0-b0ca-4aff-844b-4347d1c326da', 'volume_name': 'volume-e1831ff0-b0ca-4aff-844b-4347d1c326da', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8ef441-e160-470e-919a-4fb68d993f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8ef441-e160-470e-919a-4fb68d993f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad8aada-a7e2-4323-a02f-4d0ffb472584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:30 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Volume e1831ff0-b0ca-4aff-844b-4347d1c326da: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e1831ff0-b0ca-4aff-844b-4347d1c326da', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Cloning e1831ff0-b0ca-4aff-844b-4347d1c326da from image 98e6a247-250b-4bb5-a947-e7f93598d16e at location (None, None). {{(pid=73403) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Acquiring lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" by "_prepare_image_cache_entry" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d20887d3-f55a-457c-bd6d-70d093474f9c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] get volume v_d20887d3-f55a-457c-bd6d-70d093474f9c info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d20887d3-f55a-457c-bd6d-70d093474f9c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d20887d3-f55a-457c-bd6d-70d093474f9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d20887d3-f55a-457c-bd6d-70d093474f9c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442498', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112515', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10397629087056302604', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bb8146514faee51f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303700992', 'san:volume_id': 'bb8146514faee51f93491d850a53aab42f344475', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84896', 'name': 'v_d20887d3-f55a-457c-bd6d-70d093474f9c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d20887d3-f55a-457c-bd6d-70d093474f9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] delete volume:v_d20887d3-f55a-457c-bd6d-70d093474f9c recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d20887d3-f55a-457c-bd6d-70d093474f9c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d20887d3-f55a-457c-bd6d-70d093474f9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76249218-28ed-476b-91d3-65d84708b0af tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_db968b95-67c9-477c-832e-7fb32253c074'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-76249218-28ed-476b-91d3-65d84708b0af tempest-SnapshotsActionsTest-1419620875 None] create volume s_db968b95-67c9-477c-832e-7fb32253c074 from snapshot s_db968b95-67c9-477c-832e-7fb32253c074 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:58:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76249218-28ed-476b-91d3-65d84708b0af tempest-SnapshotsActionsTest-1419620875 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76249218-28ed-476b-91d3-65d84708b0af tempest-SnapshotsActionsTest-1419620875 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76249218-28ed-476b-91d3-65d84708b0af tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ceda750c-3661-4806-9e27-2013edcf9d2f@s_db968b95-67c9-477c-832e-7fb32253c074', 'is_clone': True, 'full_name': 'Pool-0/s_db968b95-67c9-477c-832e-7fb32253c074', 'name': 's_db968b95-67c9-477c-832e-7fb32253c074'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76249218-28ed-476b-91d3-65d84708b0af tempest-SnapshotsActionsTest-1419620875 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_db968b95-67c9-477c-832e-7fb32253c074/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76249218-28ed-476b-91d3-65d84708b0af tempest-SnapshotsActionsTest-1419620875 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_db968b95-67c9-477c-832e-7fb32253c074/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d20887d3-f55a-457c-bd6d-70d093474f9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] volume v_d20887d3-f55a-457c-bd6d-70d093474f9c deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:58:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76249218-28ed-476b-91d3-65d84708b0af tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_db968b95-67c9-477c-832e-7fb32253c074/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-76249218-28ed-476b-91d3-65d84708b0af tempest-SnapshotsActionsTest-1419620875 None] volume s_db968b95-67c9-477c-832e-7fb32253c074 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:58:32 user cinder-volume[73403]: DEBUG cinder.quota [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Created reservations ['babda5e8-1972-4d87-92cb-7368f44a5e57', '347bfb70-d051-4b50-a35e-bf301ac5dcdc', 'beebef5b-99bb-459b-bff0-c8019e8dbb89', '62b172ae-0678-49df-8cd6-21b18dae0318'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:32 user cinder-volume[73403]: INFO cinder.volume.manager [None req-76249218-28ed-476b-91d3-65d84708b0af tempest-SnapshotsActionsTest-1419620875 None] Create snapshot completed successfully Apr 14 02:58:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:58:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:58:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] atach volume v_45e86581-88e9-4ace-b9df-10ddbc786335 to target iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 02:58:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Geting {'code': 200, 'error': None, 'data': {'available': '114303758336', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:58:33 user cinder-volume[73403]: DEBUG cinder.manager [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:58:33 user cinder-volume[73403]: INFO cinder.volume.manager [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Deleted volume successfully. Apr 14 02:58:33 user cinder-volume[73403]: DEBUG cinder.coordination [None req-97b879fd-a808-4e64-9c9c-1702ecb4d6c2 tempest-VolumesListAdminTestJSON-981052236 None] Lock "cinder-d20887d3-f55a-457c-bd6d-70d093474f9c-delete_volume" released by "delete_volume" :: held 4.189s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:58:34 user cinder-volume[73403]: DEBUG cinder.coordination [None req-892618b2-cfcf-46bd-81b4-835e4eeb0f6d tempest-SnapshotsActionsTest-451765625 None] Acquiring lock "cinder-db968b95-67c9-477c-832e-7fb32253c074-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:58:34 user cinder-volume[73403]: DEBUG cinder.coordination [None req-892618b2-cfcf-46bd-81b4-835e4eeb0f6d tempest-SnapshotsActionsTest-451765625 None] Lock "cinder-db968b95-67c9-477c-832e-7fb32253c074-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:58:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-892618b2-cfcf-46bd-81b4-835e4eeb0f6d tempest-SnapshotsActionsTest-451765625 None] deleating snapshot s_db968b95-67c9-477c-832e-7fb32253c074. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:58:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-892618b2-cfcf-46bd-81b4-835e4eeb0f6d tempest-SnapshotsActionsTest-451765625 None] get snapshots for volume s_db968b95-67c9-477c-832e-7fb32253c074 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:58:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-892618b2-cfcf-46bd-81b4-835e4eeb0f6d tempest-SnapshotsActionsTest-451765625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_db968b95-67c9-477c-832e-7fb32253c074/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-892618b2-cfcf-46bd-81b4-835e4eeb0f6d tempest-SnapshotsActionsTest-451765625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_db968b95-67c9-477c-832e-7fb32253c074/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6438626366613062', 'lun': 0, 'mode': 'wt', 'name': 'v_45e86581-88e9-4ace-b9df-10ddbc786335', 'prod_id': 'Storage', 'scsi_id': 'd8bcfa0b4361255b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] add credentails to target iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 02:58:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-892618b2-cfcf-46bd-81b4-835e4eeb0f6d tempest-SnapshotsActionsTest-451765625 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_db968b95-67c9-477c-832e-7fb32253c074/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-892618b2-cfcf-46bd-81b4-835e4eeb0f6d tempest-SnapshotsActionsTest-451765625 None] get volume s_db968b95-67c9-477c-832e-7fb32253c074 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:58:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-892618b2-cfcf-46bd-81b4-835e4eeb0f6d tempest-SnapshotsActionsTest-451765625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_db968b95-67c9-477c-832e-7fb32253c074 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-892618b2-cfcf-46bd-81b4-835e4eeb0f6d tempest-SnapshotsActionsTest-451765625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_db968b95-67c9-477c-832e-7fb32253c074 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-892618b2-cfcf-46bd-81b4-835e4eeb0f6d tempest-SnapshotsActionsTest-451765625 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ceda750c-3661-4806-9e27-2013edcf9d2f@s_db968b95-67c9-477c-832e-7fb32253c074', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_db968b95-67c9-477c-832e-7fb32253c074', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442520', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112572', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7749650456099350693', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '02173b7d03b759b2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114303746048', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84281', 'name': 's_db968b95-67c9-477c-832e-7fb32253c074', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_db968b95-67c9-477c-832e-7fb32253c074 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-892618b2-cfcf-46bd-81b4-835e4eeb0f6d tempest-SnapshotsActionsTest-451765625 None] delete snapshot s_db968b95-67c9-477c-832e-7fb32253c074 of volume v_ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:58:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-892618b2-cfcf-46bd-81b4-835e4eeb0f6d tempest-SnapshotsActionsTest-451765625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots/s_db968b95-67c9-477c-832e-7fb32253c074 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-892618b2-cfcf-46bd-81b4-835e4eeb0f6d tempest-SnapshotsActionsTest-451765625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots/s_db968b95-67c9-477c-832e-7fb32253c074 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Geting {'code': 201, 'error': None, 'data': {'name': 'LtcmwMJp'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] initialize_connection for 45e86581-88e9-4ace-b9df-10ddbc786335 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connector [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Factory for iscsi on None {{(pid=73403) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtcmwMJp', 'auth_password': '***', 'target_lun': False}}" {{(pid=73403) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.017s {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 02:58:35 user cinder-volume[73403]: INFO os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Trying to connect to iSCSI portal 172.16.0.220:3260 Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260" returned: 21 in 0.050s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[14538785-a931-4ea3-b990-3e1bc30fad0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Apr 14 02:58:35 user cinder-volume[73403]: {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 --interface default --op new {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd60fda-2d79-43bc-9871-d43b84c4f451]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335] added\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335] added Apr 14 02:58:35 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d50963-a384-476c-b1e1-71c194b4f911]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[985cde92-814f-4244-af70-705cd4f1633f]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtcmwMJp {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtcmwMJp" returned: 0 in 0.031s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba406ae-a44c-489f-be45-740f6f59231b]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LtcmwMJp'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7938efa-7eaa-49b4-ba85-412840c1f865]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.038s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[32667c0b-3445-4efc-9f46-b13d8fe17ac8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Apr 14 02:58:35 user cinder-volume[73403]: {{(pid=73403) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Apr 14 02:58:35 user cinder-volume[73403]: {{(pid=73403) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 02:58:35 user cinder-volume[73403]: WARNING os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Apr 14 02:58:35 user cinder-volume[73403]: Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 --login {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 --login" returned: 0 in 0.180s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[846715f9-51a9-4611-b1f1-6ef5ff8e38de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335, portal: 172.16.0.220,3260] Apr 14 02:58:35 user cinder-volume[73403]: Login to [iface: default, target: iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335, portal: 172.16.0.220,3260] successful. Apr 14 02:58:35 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2a08c8-f45f-4668-a4ee-b8fa9a86e340]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43dd1a3-983a-4c1e-878c-d91ca813cf6d]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 (non-flash)\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 (non-flash) Apr 14 02:58:35 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 (non-flash) Apr 14 02:58:35 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.537s {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Connected to 172.16.0.220:3260 {{(pid=73403) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] HCTL ('33', '-', '-', 0) found on session 1 with lun 0 {{(pid=73403) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Scanning host 33 c: -, t: -, l: 0) {{(pid=73403) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.034s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3f9a43-37a7-4286-93eb-dd77ff34c953]: (4, ('- - 0', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Searching for a device in session 1 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73403) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}} Apr 14 02:58:35 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtcmwMJp', 'auth_password': '***', 'target_lun': False} {{(pid=73403) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}} Apr 14 02:58:36 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.611s {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 02:58:36 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] <== connect_volume: return (1630ms) {'type': 'block', 'scsi_wwn': '26438626366613062', 'path': '/dev/sdb'} {{(pid=73403) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 02:58:36 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): dd if=/dev/sdb of=/dev/null count=1 {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:36 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "dd if=/dev/sdb of=/dev/null count=1" returned: 0 in 0.031s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:36 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a86ef59-7363-4782-8b8e-aa2da26dae8d]: (4, ('', '1+0 records in\n1+0 records out\n512 bytes copied, 0.00329305 s, 155 kB/s\n')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-892618b2-cfcf-46bd-81b4-835e4eeb0f6d tempest-SnapshotsActionsTest-451765625 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots/s_db968b95-67c9-477c-832e-7fb32253c074 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-892618b2-cfcf-46bd-81b4-835e4eeb0f6d tempest-SnapshotsActionsTest-451765625 None] snapshot s_db968b95-67c9-477c-832e-7fb32253c074 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:58:36 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_98e6a247-250b-4bb5-a947-e7f93598d16e_nr71cci4 {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:36 user cinder-volume[73403]: DEBUG cinder.quota [None req-892618b2-cfcf-46bd-81b4-835e4eeb0f6d tempest-SnapshotsActionsTest-451765625 None] Created reservations ['cb291131-6e3f-4d71-b017-fd289f402a31', '4806151d-c165-40cc-a62c-70400adc0ec1', '6c57d137-98de-402d-9e7e-432c29b49e86', '6bd06982-c7aa-44d5-a203-6005bc5fa7ac'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:36 user cinder-volume[73403]: INFO cinder.volume.manager [None req-892618b2-cfcf-46bd-81b4-835e4eeb0f6d tempest-SnapshotsActionsTest-451765625 None] Delete snapshot completed successfully. Apr 14 02:58:36 user cinder-volume[73403]: DEBUG cinder.coordination [None req-892618b2-cfcf-46bd-81b4-835e4eeb0f6d tempest-SnapshotsActionsTest-451765625 None] Lock "cinder-db968b95-67c9-477c-832e-7fb32253c074-delete_snapshot" released by "delete_snapshot" :: held 2.912s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:58:37 user sudo[81512]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_98e6a247-250b-4bb5-a947-e7f93598d16e_nr71cci4 Apr 14 02:58:37 user sudo[81512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 02:58:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-207849ea-20c3-45ac-8986-31c073daffab tempest-SnapshotsActionsTest-1419620875 None] create snapshot c6fff50d-047f-49bd-aaba-09d74552f0ff for volume ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:58:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-207849ea-20c3-45ac-8986-31c073daffab tempest-SnapshotsActionsTest-1419620875 None] cloning v_ceda750c-3661-4806-9e27-2013edcf9d2f to s_c6fff50d-047f-49bd-aaba-09d74552f0ff {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:58:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-207849ea-20c3-45ac-8986-31c073daffab tempest-SnapshotsActionsTest-1419620875 None] create snapshot s_c6fff50d-047f-49bd-aaba-09d74552f0ff {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:58:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-207849ea-20c3-45ac-8986-31c073daffab tempest-SnapshotsActionsTest-1419620875 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-207849ea-20c3-45ac-8986-31c073daffab tempest-SnapshotsActionsTest-1419620875 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:37 user sudo[81512]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:37 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_98e6a247-250b-4bb5-a947-e7f93598d16e_nr71cci4" returned: 0 in 0.927s {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:37 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_98e6a247-250b-4bb5-a947-e7f93598d16e_pcfd_1ntuser@joviandss-2 {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:37 user sudo[81516]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_98e6a247-250b-4bb5-a947-e7f93598d16e_pcfd_1ntuser@joviandss-2 Apr 14 02:58:37 user sudo[81516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 02:58:38 user sudo[81516]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:38 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_98e6a247-250b-4bb5-a947-e7f93598d16e_pcfd_1ntuser@joviandss-2" returned: 0 in 0.885s {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:38 user cinder-volume[73403]: DEBUG cinder.image.image_utils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] 98e6a247-250b-4bb5-a947-e7f93598d16e was qcow2, converting to raw {{(pid=73403) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:976}} Apr 14 02:58:38 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_98e6a247-250b-4bb5-a947-e7f93598d16e_pcfd_1ntuser@joviandss-2 of=/dev/sdb oflag=direct {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:38 user sudo[81521]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_98e6a247-250b-4bb5-a947-e7f93598d16e_pcfd_1ntuser@joviandss-2 of=/dev/sdb oflag=direct Apr 14 02:58:38 user sudo[81521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 02:58:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-207849ea-20c3-45ac-8986-31c073daffab tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_c6fff50d-047f-49bd-aaba-09d74552f0ff'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-207849ea-20c3-45ac-8986-31c073daffab tempest-SnapshotsActionsTest-1419620875 None] create volume s_c6fff50d-047f-49bd-aaba-09d74552f0ff from snapshot s_c6fff50d-047f-49bd-aaba-09d74552f0ff {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:58:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-207849ea-20c3-45ac-8986-31c073daffab tempest-SnapshotsActionsTest-1419620875 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-207849ea-20c3-45ac-8986-31c073daffab tempest-SnapshotsActionsTest-1419620875 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:39 user sudo[81521]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:39 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_98e6a247-250b-4bb5-a947-e7f93598d16e_pcfd_1ntuser@joviandss-2 of=/dev/sdb oflag=direct" returned: 0 in 0.935s {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:39 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_98e6a247-250b-4bb5-a947-e7f93598d16e_pcfd_1ntuser@joviandss-2 /dev/sdb {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:39 user sudo[81531]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_98e6a247-250b-4bb5-a947-e7f93598d16e_pcfd_1ntuser@joviandss-2 /dev/sdb Apr 14 02:58:39 user sudo[81531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 02:58:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-207849ea-20c3-45ac-8986-31c073daffab tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ceda750c-3661-4806-9e27-2013edcf9d2f@s_c6fff50d-047f-49bd-aaba-09d74552f0ff', 'is_clone': True, 'full_name': 'Pool-0/s_c6fff50d-047f-49bd-aaba-09d74552f0ff', 'name': 's_c6fff50d-047f-49bd-aaba-09d74552f0ff'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-207849ea-20c3-45ac-8986-31c073daffab tempest-SnapshotsActionsTest-1419620875 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c6fff50d-047f-49bd-aaba-09d74552f0ff/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-207849ea-20c3-45ac-8986-31c073daffab tempest-SnapshotsActionsTest-1419620875 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c6fff50d-047f-49bd-aaba-09d74552f0ff/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-207849ea-20c3-45ac-8986-31c073daffab tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c6fff50d-047f-49bd-aaba-09d74552f0ff/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-207849ea-20c3-45ac-8986-31c073daffab tempest-SnapshotsActionsTest-1419620875 None] volume s_c6fff50d-047f-49bd-aaba-09d74552f0ff properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:58:39 user cinder-volume[73403]: INFO cinder.volume.manager [None req-207849ea-20c3-45ac-8986-31c073daffab tempest-SnapshotsActionsTest-1419620875 None] Create snapshot completed successfully Apr 14 02:58:40 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:58:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Flow 'volume_create_manager' (47843d80-1811-4a40-878a-37a302fe42fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137efd4a-2767-429e-89af-80dcf8e4146e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137efd4a-2767-429e-89af-80dcf8e4146e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1443787178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2293bfe7e844bba9c6a043ef04fcf89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:58:41Z,use_quota=True,user_id='b0f8e76af62c4b03948441942c71f974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a7e514-abd6-465a-8ee4-7576523f118f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a7e514-abd6-465a-8ee4-7576523f118f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b007fc64-782d-42b7-9cba-8ca8ebca3d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b007fc64-782d-42b7-9cba-8ca8ebca3d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e', 'volume_name': 'volume-33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d9536e-d158-4b4b-9d19-33ba8ed68f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d9536e-d158-4b4b-9d19-33ba8ed68f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd67caa-af62-4a3a-8c11-6276ac6022ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:40 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Volume 33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e', 'volume_size': 1} Apr 14 02:58:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] creating volume v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:58:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] create volume {'name': 'v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:58:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:41 user cinder-volume[73403]: DEBUG cinder.coordination [None req-78bf7231-e63e-4079-9ed5-0fe38780a032 tempest-SnapshotsActionsTest-451765625 None] Acquiring lock "cinder-c6fff50d-047f-49bd-aaba-09d74552f0ff-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:58:41 user cinder-volume[73403]: DEBUG cinder.coordination [None req-78bf7231-e63e-4079-9ed5-0fe38780a032 tempest-SnapshotsActionsTest-451765625 None] Lock "cinder-c6fff50d-047f-49bd-aaba-09d74552f0ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:58:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-78bf7231-e63e-4079-9ed5-0fe38780a032 tempest-SnapshotsActionsTest-451765625 None] deleating snapshot s_c6fff50d-047f-49bd-aaba-09d74552f0ff. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:58:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-78bf7231-e63e-4079-9ed5-0fe38780a032 tempest-SnapshotsActionsTest-451765625 None] get snapshots for volume s_c6fff50d-047f-49bd-aaba-09d74552f0ff {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:58:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78bf7231-e63e-4079-9ed5-0fe38780a032 tempest-SnapshotsActionsTest-451765625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c6fff50d-047f-49bd-aaba-09d74552f0ff/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78bf7231-e63e-4079-9ed5-0fe38780a032 tempest-SnapshotsActionsTest-451765625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c6fff50d-047f-49bd-aaba-09d74552f0ff/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:41 user sudo[81531]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:41 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_98e6a247-250b-4bb5-a947-e7f93598d16e_pcfd_1ntuser@joviandss-2 /dev/sdb" returned: 0 in 1.728s {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:41 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_98e6a247-250b-4bb5-a947-e7f93598d16e_pcfd_1ntuser@joviandss-2 {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:41 user sudo[81559]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_98e6a247-250b-4bb5-a947-e7f93598d16e_pcfd_1ntuser@joviandss-2 Apr 14 02:58:41 user sudo[81559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 02:58:42 user sudo[81559]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_98e6a247-250b-4bb5-a947-e7f93598d16e_pcfd_1ntuser@joviandss-2" returned: 0 in 0.961s {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.image.image_utils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_98e6a247-250b-4bb5-a947-e7f93598d16e_pcfd_1ntuser@joviandss-2, size 112.00 MB, duration 1.73 sec, destination /dev/sdb {{(pid=73403) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:432}} Apr 14 02:58:42 user cinder-volume[73403]: INFO cinder.image.image_utils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Converted 112.00 MB image at 64.76 MB/s Apr 14 02:58:42 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtcmwMJp', 'auth_password': '***', 'target_lun': 0, 'encrypted': False}, {'type': 'block', 'scsi_wwn': '26438626366613062', 'path': '/dev/sdb'}), 'kwargs': {'force': False}}" {{(pid=73403) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a222ce3-1307-405a-95e3-d3880e88efcb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Apr 14 02:58:42 user cinder-volume[73403]: No targets found. Apr 14 02:58:42 user cinder-volume[73403]: iSNS: Apr 14 02:58:42 user cinder-volume[73403]: No targets found. Apr 14 02:58:42 user cinder-volume[73403]: STATIC: Apr 14 02:58:42 user cinder-volume[73403]: Target: iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 Apr 14 02:58:42 user cinder-volume[73403]: Portal: 172.16.0.220:3260,-1 Apr 14 02:58:42 user cinder-volume[73403]: Iface Name: default Apr 14 02:58:42 user cinder-volume[73403]: FIRMWARE: Apr 14 02:58:42 user cinder-volume[73403]: No targets found. Apr 14 02:58:42 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Regex to get portals from discoverydb: ^SENDTARGETS: Apr 14 02:58:42 user cinder-volume[73403]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Apr 14 02:58:42 user cinder-volume[73403]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=73403) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335', 0)] {{(pid=73403) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[690ef5a7-8964-4c37-a6bf-9f8249935960]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c18f1a3-8b7b-40f2-8a10-1f5d4de88534]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 (non-flash)\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 (non-flash) Apr 14 02:58:42 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 (non-flash) Apr 14 02:58:42 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Resulting device map defaultdict(. at 0x7f81eefb7130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335'): ({'sdb'}, set())}) {{(pid=73403) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Removing single pathed devices sdb {{(pid=73403) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[134f2abe-b612-49f4-8bc9-06f3e74474ab]: (4, ('path checker states:\nup 1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38036cd-28a0-4c9a-bfee-42dce9c7f71d]: (4, ('ok\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Flushing IO for device /dev/sdb {{(pid=73403) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.032s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe96e33-0a8a-4732-bd22-c487ca9d13ad]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73403) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1ac97c-5071-472a-bc22-1444ff28e79d]: (4, ('1', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=73403) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] SCSI volumes sdb have been removed. {{(pid=73403) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335')] {{(pid=73403) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c32d1c4-caab-4e42-acf1-75ebbd950d42]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 --logout {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78bf7231-e63e-4079-9ed5-0fe38780a032 tempest-SnapshotsActionsTest-451765625 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c6fff50d-047f-49bd-aaba-09d74552f0ff/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-78bf7231-e63e-4079-9ed5-0fe38780a032 tempest-SnapshotsActionsTest-451765625 None] get volume s_c6fff50d-047f-49bd-aaba-09d74552f0ff info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78bf7231-e63e-4079-9ed5-0fe38780a032 tempest-SnapshotsActionsTest-451765625 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c6fff50d-047f-49bd-aaba-09d74552f0ff {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78bf7231-e63e-4079-9ed5-0fe38780a032 tempest-SnapshotsActionsTest-451765625 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c6fff50d-047f-49bd-aaba-09d74552f0ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3ebf30-86b1-4c95-b275-720810d7a433]: (4, ('Logging out of session [sid: 1, target: iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335, portal: 172.16.0.220,3260]\nLogout of [sid: 1, target: iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 1, target: iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335, portal: 172.16.0.220,3260] Apr 14 02:58:42 user cinder-volume[73403]: Logout of [sid: 1, target: iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335, portal: 172.16.0.220,3260] successful. Apr 14 02:58:42 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 --op delete {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad8bf98-a668-49de-b3a5-21edf4f65782]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] <== disconnect_volume: return (341ms) None {{(pid=73403) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] terminate connection for 45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.driver [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] volume 45e86581-88e9-4ace-b9df-10ddbc786335: removing export {{(pid=73403) _detach_volume /opt/stack/cinder/cinder/volume/driver.py:560}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] remove_export for volume: 45e86581-88e9-4ace-b9df-10ddbc786335. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1840409834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=45e86581-88e9-4ace-b9df-10ddbc786335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71e39d23c69541d09fe3f89bc0b20a8e',provider_auth='CHAP LtcmwMJp KnPidLmMoxj9aZ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='downloading',terminated_at=None,updated_at=2023-04-14T02:58:20Z,use_quota=True,user_id='72ecb8d5049842ee801fc8ea5f83428a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] detach volume v_45e86581-88e9-4ace-b9df-10ddbc786335 from target iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335/luns/v_45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335/luns/v_45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78bf7231-e63e-4079-9ed5-0fe38780a032 tempest-SnapshotsActionsTest-451765625 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ceda750c-3661-4806-9e27-2013edcf9d2f@s_c6fff50d-047f-49bd-aaba-09d74552f0ff', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_c6fff50d-047f-49bd-aaba-09d74552f0ff', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442528', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112587', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6485892561338753480', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'fb9ed8a3b5e4bd21', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114287435776', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '83160', 'name': 's_c6fff50d-047f-49bd-aaba-09d74552f0ff', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c6fff50d-047f-49bd-aaba-09d74552f0ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-78bf7231-e63e-4079-9ed5-0fe38780a032 tempest-SnapshotsActionsTest-451765625 None] delete snapshot s_c6fff50d-047f-49bd-aaba-09d74552f0ff of volume v_ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78bf7231-e63e-4079-9ed5-0fe38780a032 tempest-SnapshotsActionsTest-451765625 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots/s_c6fff50d-047f-49bd-aaba-09d74552f0ff {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78bf7231-e63e-4079-9ed5-0fe38780a032 tempest-SnapshotsActionsTest-451765625 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots/s_c6fff50d-047f-49bd-aaba-09d74552f0ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e', 'is_clone': False, 'name': 'v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd67caa-af62-4a3a-8c11-6276ac6022ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d3fc75-6387-4e7d-b3dc-067532ee4805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:42 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Volume volume-33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e (33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e): created successfully Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d3fc75-6387-4e7d-b3dc-067532ee4805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Flow 'volume_create_manager' (47843d80-1811-4a40-878a-37a302fe42fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:42 user cinder-volume[73403]: INFO cinder.volume.manager [None req-38a4b28c-ac9c-4a1f-b210-7fd82105a61b tempest-SnapshotMetadataTestJSON-1572189114 None] Created volume successfully. Apr 14 02:58:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-94f6103a-3d2c-4d73-becb-3ae6405efbdf tempest-SnapshotMetadataTestJSON-1572189114 None] create snapshot a83c8c39-739a-4a74-9f19-dc34ef6fec02 for volume 33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:58:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-94f6103a-3d2c-4d73-becb-3ae6405efbdf tempest-SnapshotMetadataTestJSON-1572189114 None] cloning v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e to s_a83c8c39-739a-4a74-9f19-dc34ef6fec02 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:58:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-94f6103a-3d2c-4d73-becb-3ae6405efbdf tempest-SnapshotMetadataTestJSON-1572189114 None] create snapshot s_a83c8c39-739a-4a74-9f19-dc34ef6fec02 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:58:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94f6103a-3d2c-4d73-becb-3ae6405efbdf tempest-SnapshotMetadataTestJSON-1572189114 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94f6103a-3d2c-4d73-becb-3ae6405efbdf tempest-SnapshotMetadataTestJSON-1572189114 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78bf7231-e63e-4079-9ed5-0fe38780a032 tempest-SnapshotsActionsTest-451765625 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots/s_c6fff50d-047f-49bd-aaba-09d74552f0ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-78bf7231-e63e-4079-9ed5-0fe38780a032 tempest-SnapshotsActionsTest-451765625 None] snapshot s_c6fff50d-047f-49bd-aaba-09d74552f0ff deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:58:44 user cinder-volume[73403]: DEBUG cinder.quota [None req-78bf7231-e63e-4079-9ed5-0fe38780a032 tempest-SnapshotsActionsTest-451765625 None] Created reservations ['3057e0ee-a09b-4c51-9cd8-17571689e85b', '7d97c5e7-6f9d-4c69-b6f9-b610e9489f1a', 'e67eb62b-eb1f-4e1e-8569-b8777b2edcf1', '720faa87-59fa-4d59-8529-4ad804e6f997'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:44 user cinder-volume[73403]: INFO cinder.volume.manager [None req-78bf7231-e63e-4079-9ed5-0fe38780a032 tempest-SnapshotsActionsTest-451765625 None] Delete snapshot completed successfully. Apr 14 02:58:44 user cinder-volume[73403]: DEBUG cinder.coordination [None req-78bf7231-e63e-4079-9ed5-0fe38780a032 tempest-SnapshotsActionsTest-451765625 None] Lock "cinder-c6fff50d-047f-49bd-aaba-09d74552f0ff-delete_snapshot" released by "delete_snapshot" :: held 3.293s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:58:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335/luns/v_45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] delete target: iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:58:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] delete target iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:58:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] target iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Downloaded image 98e6a247-250b-4bb5-a947-e7f93598d16e ((None, None)) to volume 45e86581-88e9-4ace-b9df-10ddbc786335 successfully. {{(pid=73403) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1232}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.image.image_utils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Temporary image 98e6a247-250b-4bb5-a947-e7f93598d16e for user 72ecb8d5049842ee801fc8ea5f83428a is deleted. {{(pid=73403) fetch /opt/stack/cinder/cinder/image/image_utils.py:1283}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=59,cinder:INSERT=6,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=58,cinder:UPDATE=33,cinder:DELETE=2,cinder:INSERT=7 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.quota [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Created reservations ['db0acc40-1d5d-45d4-a187-4ba651cc5a18', 'b3141f59-7151-4b43-925b-83ebe3600fe1', '6051ea62-97d5-446a-aa66-35840f90c180', 'e3eca54f-093f-45ca-a8da-dd7bea3c1ce0'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Creating image volume entry: {'cluster_name': None, 'scheduled_at': datetime.datetime(2023, 4, 14, 2, 58, 20, tzinfo=datetime.timezone.utc), 'launched_at': None, 'display_description': None, 'created_at': datetime.datetime(2023, 4, 14, 2, 58, 19, tzinfo=datetime.timezone.utc), 'replication_extended_status': None, 'service_uuid': None, 'availability_zone': 'nova', 'user_id': '72ecb8d5049842ee801fc8ea5f83428a', 'multiattach': False, 'ec2_id': None, 'volume_type_id': 'add04113-84a3-47ba-8fde-ec2400cf3204', 'deleted': False, 'replication_status': None, 'size': 1, 'volume_metadata': [], 'provider_auth': 'CHAP LtcmwMJp KnPidLmMoxj9aZ', 'updated_at': datetime.datetime(2023, 4, 14, 2, 58, 20, tzinfo=datetime.timezone.utc), 'shared_targets': True, 'display_name': 'image-98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'consistencygroup_id': None, 'replication_driver_data': None, 'encryption_key_id': None, 'provider_id': None, 'host': 'user@joviandss-2#joviandss-2', 'volume_admin_metadata': [], 'project_id': '26e1e7b31d8647499d4f6edae9f171df', 'terminated_at': None, 'group_id': None, 'metadata': {}, 'provider_location': '172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 0', 'bootable': False, 'deleted_at': None, 'provider_geometry': None, 'previous_status': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '45e86581-88e9-4ace-b9df-10ddbc786335'}. {{(pid=73403) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1660}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Volume reschedule parameters: False retry: None {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Flow 'volume_create_manager' (1b24c2ac-1eec-4b49-aa51-482ce7176345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750629f7-8eca-43ec-87f8-f8b431e49a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750629f7-8eca-43ec-87f8-f8b431e49a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='image-98e6a247-250b-4bb5-a947-e7f93598d16e',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=482f938f-083c-4221-99f8-3320a80b8725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e1e7b31d8647499d4f6edae9f171df',provider_auth='CHAP LtcmwMJp KnPidLmMoxj9aZ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=45e86581-88e9-4ace-b9df-10ddbc786335,status='creating',terminated_at=None,updated_at=2023-04-14T02:58:20Z,use_quota=True,user_id='72ecb8d5049842ee801fc8ea5f83428a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a90219-83ff-4021-b6d2-8b96092127d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a90219-83ff-4021-b6d2-8b96092127d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58301038-fb97-4090-92a8-b47dc7e1c860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58301038-fb97-4090-92a8-b47dc7e1c860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'volume_name': 'volume-482f938f-083c-4221-99f8-3320a80b8725', 'volume_size': 1, 'source_volid': '45e86581-88e9-4ace-b9df-10ddbc786335', 'source_volstatus': 'downloading'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf632ba-8e0f-422b-b8a2-c8159abed469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf632ba-8e0f-422b-b8a2-c8159abed469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7392fa24-ed97-40e5-a4da-e15d2facc8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:45 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Volume 482f938f-083c-4221-99f8-3320a80b8725: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-482f938f-083c-4221-99f8-3320a80b8725', 'volume_size': 1, 'source_volid': '45e86581-88e9-4ace-b9df-10ddbc786335', 'source_volstatus': 'downloading'} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] cloned volume 45e86581-88e9-4ace-b9df-10ddbc786335 to 482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] cloning v_45e86581-88e9-4ace-b9df-10ddbc786335 to v_482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] create snapshot v_482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45e86581-88e9-4ace-b9df-10ddbc786335/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45e86581-88e9-4ace-b9df-10ddbc786335/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94f6103a-3d2c-4d73-becb-3ae6405efbdf tempest-SnapshotMetadataTestJSON-1572189114 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_a83c8c39-739a-4a74-9f19-dc34ef6fec02'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-94f6103a-3d2c-4d73-becb-3ae6405efbdf tempest-SnapshotMetadataTestJSON-1572189114 None] create volume s_a83c8c39-739a-4a74-9f19-dc34ef6fec02 from snapshot s_a83c8c39-739a-4a74-9f19-dc34ef6fec02 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94f6103a-3d2c-4d73-becb-3ae6405efbdf tempest-SnapshotMetadataTestJSON-1572189114 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94f6103a-3d2c-4d73-becb-3ae6405efbdf tempest-SnapshotMetadataTestJSON-1572189114 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5746f677-3935-4280-b9ca-4fdd72e639b5 tempest-SnapshotsActionsTest-1419620875 None] Acquiring lock "cinder-3daf5d87-24e6-41c6-bf3c-917855a7dbbf-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5746f677-3935-4280-b9ca-4fdd72e639b5 tempest-SnapshotsActionsTest-1419620875 None] Lock "cinder-3daf5d87-24e6-41c6-bf3c-917855a7dbbf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5746f677-3935-4280-b9ca-4fdd72e639b5 tempest-SnapshotsActionsTest-1419620875 None] deleating snapshot s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5746f677-3935-4280-b9ca-4fdd72e639b5 tempest-SnapshotsActionsTest-1419620875 None] get snapshots for volume s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5746f677-3935-4280-b9ca-4fdd72e639b5 tempest-SnapshotsActionsTest-1419620875 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5746f677-3935-4280-b9ca-4fdd72e639b5 tempest-SnapshotsActionsTest-1419620875 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94f6103a-3d2c-4d73-becb-3ae6405efbdf tempest-SnapshotMetadataTestJSON-1572189114 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e@s_a83c8c39-739a-4a74-9f19-dc34ef6fec02', 'is_clone': True, 'full_name': 'Pool-0/s_a83c8c39-739a-4a74-9f19-dc34ef6fec02', 'name': 's_a83c8c39-739a-4a74-9f19-dc34ef6fec02'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94f6103a-3d2c-4d73-becb-3ae6405efbdf tempest-SnapshotMetadataTestJSON-1572189114 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a83c8c39-739a-4a74-9f19-dc34ef6fec02/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94f6103a-3d2c-4d73-becb-3ae6405efbdf tempest-SnapshotMetadataTestJSON-1572189114 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a83c8c39-739a-4a74-9f19-dc34ef6fec02/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94f6103a-3d2c-4d73-becb-3ae6405efbdf tempest-SnapshotMetadataTestJSON-1572189114 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a83c8c39-739a-4a74-9f19-dc34ef6fec02/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-94f6103a-3d2c-4d73-becb-3ae6405efbdf tempest-SnapshotMetadataTestJSON-1572189114 None] volume s_a83c8c39-739a-4a74-9f19-dc34ef6fec02 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:58:46 user cinder-volume[73403]: INFO cinder.volume.manager [None req-94f6103a-3d2c-4d73-becb-3ae6405efbdf tempest-SnapshotMetadataTestJSON-1572189114 None] Create snapshot completed successfully Apr 14 02:58:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_482f938f-083c-4221-99f8-3320a80b8725'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45e86581-88e9-4ace-b9df-10ddbc786335/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] create volume v_482f938f-083c-4221-99f8-3320a80b8725 from snapshot v_482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:58:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45e86581-88e9-4ace-b9df-10ddbc786335/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45e86581-88e9-4ace-b9df-10ddbc786335/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5746f677-3935-4280-b9ca-4fdd72e639b5 tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5746f677-3935-4280-b9ca-4fdd72e639b5 tempest-SnapshotsActionsTest-1419620875 None] get volume s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:58:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5746f677-3935-4280-b9ca-4fdd72e639b5 tempest-SnapshotsActionsTest-1419620875 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5746f677-3935-4280-b9ca-4fdd72e639b5 tempest-SnapshotsActionsTest-1419620875 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_45e86581-88e9-4ace-b9df-10ddbc786335@v_482f938f-083c-4221-99f8-3320a80b8725', 'is_clone': True, 'full_name': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725', 'name': 'v_482f938f-083c-4221-99f8-3320a80b8725'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45e86581-88e9-4ace-b9df-10ddbc786335/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] get volume v_482f938f-083c-4221-99f8-3320a80b8725 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:58:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5746f677-3935-4280-b9ca-4fdd72e639b5 tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ceda750c-3661-4806-9e27-2013edcf9d2f@s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442501', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112522', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9725823164347837036', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8ba526090885de76', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114287366144', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84911', 'name': 's_3daf5d87-24e6-41c6-bf3c-917855a7dbbf', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5746f677-3935-4280-b9ca-4fdd72e639b5 tempest-SnapshotsActionsTest-1419620875 None] delete snapshot s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf of volume v_ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:58:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5746f677-3935-4280-b9ca-4fdd72e639b5 tempest-SnapshotsActionsTest-1419620875 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots/s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5746f677-3935-4280-b9ca-4fdd72e639b5 tempest-SnapshotsActionsTest-1419620875 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots/s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_45e86581-88e9-4ace-b9df-10ddbc786335@v_482f938f-083c-4221-99f8-3320a80b8725', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442536', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '112612', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5716050101099174974', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '521c1638d85d3d2b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114287366144', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '83172', 'name': 'v_482f938f-083c-4221-99f8-3320a80b8725', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7392fa24-ed97-40e5-a4da-e15d2facc8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-482f938f-083c-4221-99f8-3320a80b8725', 'volume_size': 1, 'source_volid': '45e86581-88e9-4ace-b9df-10ddbc786335', 'source_volstatus': 'downloading'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97175fa2-718f-49da-b72a-559d83b85ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:47 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Volume volume-482f938f-083c-4221-99f8-3320a80b8725 (482f938f-083c-4221-99f8-3320a80b8725): created successfully Apr 14 02:58:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97175fa2-718f-49da-b72a-559d83b85ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Flow 'volume_create_manager' (1b24c2ac-1eec-4b49-aa51-482ce7176345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:47 user cinder-volume[73403]: INFO cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Created volume successfully. Apr 14 02:58:47 user cinder-volume[73403]: DEBUG cinder.coordination [None req-23c9b3c2-52a4-4b91-a905-a637e91b4e6c tempest-SnapshotMetadataTestJSON-1572189114 None] Acquiring lock "cinder-a83c8c39-739a-4a74-9f19-dc34ef6fec02-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.coordination [None req-23c9b3c2-52a4-4b91-a905-a637e91b4e6c tempest-SnapshotMetadataTestJSON-1572189114 None] Lock "cinder-a83c8c39-739a-4a74-9f19-dc34ef6fec02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-23c9b3c2-52a4-4b91-a905-a637e91b4e6c tempest-SnapshotMetadataTestJSON-1572189114 None] deleating snapshot s_a83c8c39-739a-4a74-9f19-dc34ef6fec02. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-23c9b3c2-52a4-4b91-a905-a637e91b4e6c tempest-SnapshotMetadataTestJSON-1572189114 None] get snapshots for volume s_a83c8c39-739a-4a74-9f19-dc34ef6fec02 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23c9b3c2-52a4-4b91-a905-a637e91b4e6c tempest-SnapshotMetadataTestJSON-1572189114 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a83c8c39-739a-4a74-9f19-dc34ef6fec02/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23c9b3c2-52a4-4b91-a905-a637e91b4e6c tempest-SnapshotMetadataTestJSON-1572189114 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a83c8c39-739a-4a74-9f19-dc34ef6fec02/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Creating new image-volume cache entry for image 98e6a247-250b-4bb5-a947-e7f93598d16e on user@joviandss-2#joviandss-2 {{(pid=73403) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] New image-volume cache entry created: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 2, 58, 48, 35795)}. {{(pid=73403) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" released by "_prepare_image_cache_entry" :: held 27.595s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Marking volume 45e86581-88e9-4ace-b9df-10ddbc786335 as bootable. {{(pid=73403) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Copying metadata from image 98e6a247-250b-4bb5-a947-e7f93598d16e to 45e86581-88e9-4ace-b9df-10ddbc786335. {{(pid=73403) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Creating volume glance metadata for volume 45e86581-88e9-4ace-b9df-10ddbc786335 backed by image 98e6a247-250b-4bb5-a947-e7f93598d16e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73403) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2bc0364-fdc8-47b3-b127-e808aec0a1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e86581-88e9-4ace-b9df-10ddbc786335', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dcdcae9-0136-4187-8891-71ab294475bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:48 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Volume volume-45e86581-88e9-4ace-b9df-10ddbc786335 (45e86581-88e9-4ace-b9df-10ddbc786335): created successfully Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dcdcae9-0136-4187-8891-71ab294475bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Flow 'volume_create_manager' (97a2ff59-9d9d-40fb-8bd1-c9b0608fbbca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:48 user cinder-volume[73403]: INFO cinder.volume.manager [None req-e21dd295-e551-487c-9463-44a638b1af2c tempest-VolumesImageMetadata-1425959751 None] Created volume successfully. Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" acquired by "_prepare_image_cache_entry" :: waited 18.330s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 2, 58, 48, 608117)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Found cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Attempting to retrieve cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 2, 58, 48, 630479)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Creating from source image-volume 482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] cloned volume 482f938f-083c-4221-99f8-3320a80b8725 to e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] cloning v_482f938f-083c-4221-99f8-3320a80b8725 to v_e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] create snapshot v_e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.coordination [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Acquiring lock "cinder-45e86581-88e9-4ace-b9df-10ddbc786335-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.coordination [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Lock "cinder-45e86581-88e9-4ace-b9df-10ddbc786335-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] remove_export for volume: 45e86581-88e9-4ace-b9df-10ddbc786335. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1840409834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=45e86581-88e9-4ace-b9df-10ddbc786335,launched_at=2023-04-14T02:58:48Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71e39d23c69541d09fe3f89bc0b20a8e',provider_auth='CHAP LtcmwMJp KnPidLmMoxj9aZ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:20Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:58:49Z,updated_at=2023-04-14T02:58:49Z,use_quota=True,user_id='72ecb8d5049842ee801fc8ea5f83428a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] detach volume v_45e86581-88e9-4ace-b9df-10ddbc786335 from target iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335/luns/v_45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335/luns/v_45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335/luns/v_45e86581-88e9-4ace-b9df-10ddbc786335'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335/luns/v_45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] failed to remove resource iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 because of JDSS resource v_45e86581-88e9-4ace-b9df-10ddbc786335 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] delete target: iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] delete target iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] failed to remove resource iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 because of JDSS resource iqn.2010-10.org.openstack:45e86581-88e9-4ace-b9df-10ddbc786335 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] deleating volume v_45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] get snapshots for volume v_45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45e86581-88e9-4ace-b9df-10ddbc786335/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45e86581-88e9-4ace-b9df-10ddbc786335/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5746f677-3935-4280-b9ca-4fdd72e639b5 tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots/s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5746f677-3935-4280-b9ca-4fdd72e639b5 tempest-SnapshotsActionsTest-1419620875 None] snapshot s_3daf5d87-24e6-41c6-bf3c-917855a7dbbf deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.quota [None req-5746f677-3935-4280-b9ca-4fdd72e639b5 tempest-SnapshotsActionsTest-1419620875 None] Created reservations ['09b74412-fafb-44fb-b7c5-39d5fda68bd5', '6baf2bf1-03c4-4369-9ece-d976205235b9', '678848f1-07c6-4009-83bc-1ee4d7c9e278', 'd59d2f2b-bfe2-4d3a-8ec6-6e2595305094'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:49 user cinder-volume[73403]: INFO cinder.volume.manager [None req-5746f677-3935-4280-b9ca-4fdd72e639b5 tempest-SnapshotsActionsTest-1419620875 None] Delete snapshot completed successfully. Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5746f677-3935-4280-b9ca-4fdd72e639b5 tempest-SnapshotsActionsTest-1419620875 None] Lock "cinder-3daf5d87-24e6-41c6-bf3c-917855a7dbbf-delete_snapshot" released by "delete_snapshot" :: held 3.868s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '16285696', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 05:22:15', 'volsize': '1073741824', 'createtxg': '112610', 'guid': '3316721001747613501', 'compressratio': '1.17', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '16285696', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.17', 'fscontext': 'none', 'clones': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725', 'objsetid': '84291', 'name': 'v_482f938f-083c-4221-99f8-3320a80b8725', 'defer_destroy': 'off', 'san:volume_id': 'd8bcfa0b4361255b2d998c16758d292cb0d2b2ae', 'mlslabel': 'none', 'logicalreferenced': '19042304', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45e86581-88e9-4ace-b9df-10ddbc786335/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_e1831ff0-b0ca-4aff-844b-4347d1c326da'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] create volume v_e1831ff0-b0ca-4aff-844b-4347d1c326da from snapshot v_e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:49 user cinder-volume[73403]: DEBUG cinder.coordination [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Acquiring lock "cinder-ceda750c-3661-4806-9e27-2013edcf9d2f-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.coordination [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Lock "cinder-ceda750c-3661-4806-9e27-2013edcf9d2f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] remove_export for volume: ceda750c-3661-4806-9e27-2013edcf9d2f. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-670630896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ceda750c-3661-4806-9e27-2013edcf9d2f,launched_at=2023-04-14T02:58:09Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e27d0b5762d4f5088268928796a8488',provider_auth='CHAP ghVtdzKW 1DswUGt7E0g3cu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceda750c-3661-4806-9e27-2013edcf9d2f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:08Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:58:50Z,updated_at=2023-04-14T02:58:50Z,use_quota=True,user_id='99087542458c461d99b011861d873e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:ceda750c-3661-4806-9e27-2013edcf9d2f. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] detach volume v_ceda750c-3661-4806-9e27-2013edcf9d2f from target iqn.2010-10.org.openstack:ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ceda750c-3661-4806-9e27-2013edcf9d2f/luns/v_ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ceda750c-3661-4806-9e27-2013edcf9d2f/luns/v_ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23c9b3c2-52a4-4b91-a905-a637e91b4e6c tempest-SnapshotMetadataTestJSON-1572189114 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a83c8c39-739a-4a74-9f19-dc34ef6fec02/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-23c9b3c2-52a4-4b91-a905-a637e91b4e6c tempest-SnapshotMetadataTestJSON-1572189114 None] get volume s_a83c8c39-739a-4a74-9f19-dc34ef6fec02 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23c9b3c2-52a4-4b91-a905-a637e91b4e6c tempest-SnapshotMetadataTestJSON-1572189114 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a83c8c39-739a-4a74-9f19-dc34ef6fec02 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23c9b3c2-52a4-4b91-a905-a637e91b4e6c tempest-SnapshotMetadataTestJSON-1572189114 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a83c8c39-739a-4a74-9f19-dc34ef6fec02 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ceda750c-3661-4806-9e27-2013edcf9d2f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ceda750c-3661-4806-9e27-2013edcf9d2f/luns/v_ceda750c-3661-4806-9e27-2013edcf9d2f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ceda750c-3661-4806-9e27-2013edcf9d2f/luns/v_ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] failed to remove resource iqn.2010-10.org.openstack:ceda750c-3661-4806-9e27-2013edcf9d2f because of JDSS resource v_ceda750c-3661-4806-9e27-2013edcf9d2f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] delete target: iqn.2010-10.org.openstack:ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] delete target iqn.2010-10.org.openstack:ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23c9b3c2-52a4-4b91-a905-a637e91b4e6c tempest-SnapshotMetadataTestJSON-1572189114 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e@s_a83c8c39-739a-4a74-9f19-dc34ef6fec02', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_a83c8c39-739a-4a74-9f19-dc34ef6fec02', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442534', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112607', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3044190524769869261', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '28bd814c62ff1c14', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114287341568', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84942', 'name': 's_a83c8c39-739a-4a74-9f19-dc34ef6fec02', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a83c8c39-739a-4a74-9f19-dc34ef6fec02 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-23c9b3c2-52a4-4b91-a905-a637e91b4e6c tempest-SnapshotMetadataTestJSON-1572189114 None] delete snapshot s_a83c8c39-739a-4a74-9f19-dc34ef6fec02 of volume v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23c9b3c2-52a4-4b91-a905-a637e91b4e6c tempest-SnapshotMetadataTestJSON-1572189114 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e/snapshots/s_a83c8c39-739a-4a74-9f19-dc34ef6fec02 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23c9b3c2-52a4-4b91-a905-a637e91b4e6c tempest-SnapshotMetadataTestJSON-1572189114 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e/snapshots/s_a83c8c39-739a-4a74-9f19-dc34ef6fec02 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ceda750c-3661-4806-9e27-2013edcf9d2f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ceda750c-3661-4806-9e27-2013edcf9d2f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] failed to remove resource iqn.2010-10.org.openstack:ceda750c-3661-4806-9e27-2013edcf9d2f because of JDSS resource iqn.2010-10.org.openstack:ceda750c-3661-4806-9e27-2013edcf9d2f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] deleating volume v_ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] get snapshots for volume v_ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_e1831ff0-b0ca-4aff-844b-4347d1c326da', 'is_clone': True, 'full_name': 'Pool-0/v_e1831ff0-b0ca-4aff-844b-4347d1c326da', 'name': 'v_e1831ff0-b0ca-4aff-844b-4347d1c326da'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] get volume v_e1831ff0-b0ca-4aff-844b-4347d1c326da info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_e1831ff0-b0ca-4aff-844b-4347d1c326da', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e1831ff0-b0ca-4aff-844b-4347d1c326da', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442539', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '112622', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18401571881186260834', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a65a3e005197d70a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114287329280', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84302', 'name': 'v_e1831ff0-b0ca-4aff-844b-4347d1c326da', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Marking volume e1831ff0-b0ca-4aff-844b-4347d1c326da as bootable. {{(pid=73403) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Copying metadata from image 98e6a247-250b-4bb5-a947-e7f93598d16e to e1831ff0-b0ca-4aff-844b-4347d1c326da. {{(pid=73403) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Creating volume glance metadata for volume e1831ff0-b0ca-4aff-844b-4347d1c326da backed by image 98e6a247-250b-4bb5-a947-e7f93598d16e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73403) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=60,cinder:INSERT=19,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad8aada-a7e2-4323-a02f-4d0ffb472584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1831ff0-b0ca-4aff-844b-4347d1c326da', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7964c6-de09-491c-b86e-0f9308ea948d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:50 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Volume volume-e1831ff0-b0ca-4aff-844b-4347d1c326da (e1831ff0-b0ca-4aff-844b-4347d1c326da): created successfully Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7964c6-de09-491c-b86e-0f9308ea948d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Flow 'volume_create_manager' (7c980e42-2ebe-4f7e-80ce-51d93c1e0043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:50 user cinder-volume[73403]: INFO cinder.volume.manager [None req-c0d6e990-7743-43a5-9c9c-22c58e8accfe tempest-VolumesExtendTest-1954853756 None] Created volume successfully. Apr 14 02:58:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_45e86581-88e9-4ace-b9df-10ddbc786335 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] volume v_45e86581-88e9-4ace-b9df-10ddbc786335 updated {{(pid=73403) modify_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:267}} Apr 14 02:58:51 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=61,cinder:INSERT=20,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:51 user cinder-volume[73403]: DEBUG cinder.quota [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Created reservations ['756efaf5-2bf3-46f5-a56c-53455d102f8d', 'fb3931ff-c580-42e8-b1a8-4fa60afd5800', '36e7b095-064f-4309-91b6-f558982f93fd', '340c27ca-7d07-4892-9301-509f9872313f'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:58:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:58:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23c9b3c2-52a4-4b91-a905-a637e91b4e6c tempest-SnapshotMetadataTestJSON-1572189114 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e/snapshots/s_a83c8c39-739a-4a74-9f19-dc34ef6fec02 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-23c9b3c2-52a4-4b91-a905-a637e91b4e6c tempest-SnapshotMetadataTestJSON-1572189114 None] snapshot s_a83c8c39-739a-4a74-9f19-dc34ef6fec02 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:58:51 user cinder-volume[73403]: DEBUG cinder.quota [None req-23c9b3c2-52a4-4b91-a905-a637e91b4e6c tempest-SnapshotMetadataTestJSON-1572189114 None] Created reservations ['45664731-aec2-4f12-8a3e-a28ce366519b', '939cfb0d-ae6d-4865-99b8-c1d0f77a333a', '394a6737-97be-4f74-807e-b6d0114c854a', '81c66fd4-28b4-4573-af9b-68a9143a83f7'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:51 user cinder-volume[73403]: INFO cinder.volume.manager [None req-23c9b3c2-52a4-4b91-a905-a637e91b4e6c tempest-SnapshotMetadataTestJSON-1572189114 None] Delete snapshot completed successfully. Apr 14 02:58:51 user cinder-volume[73403]: DEBUG cinder.coordination [None req-23c9b3c2-52a4-4b91-a905-a637e91b4e6c tempest-SnapshotMetadataTestJSON-1572189114 None] Lock "cinder-a83c8c39-739a-4a74-9f19-dc34ef6fec02-delete_snapshot" released by "delete_snapshot" :: held 3.865s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:58:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Geting {'code': 200, 'error': None, 'data': {'available': '114287353856', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:58:51 user cinder-volume[73403]: DEBUG cinder.manager [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:58:51 user cinder-volume[73403]: INFO cinder.volume.manager [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Deleted volume successfully. Apr 14 02:58:51 user cinder-volume[73403]: DEBUG cinder.coordination [None req-54ec34ae-8b9b-4db6-8de4-3f0c1fadba87 tempest-VolumesImageMetadata-1425959751 None] Lock "cinder-45e86581-88e9-4ace-b9df-10ddbc786335-delete_volume" released by "delete_volume" :: held 2.866s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-227ce3ab-3fa1-499a-96e8-8aa0aa9479ee tempest-VolumesExtendTest-1954853756 None] Extend volume e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-227ce3ab-3fa1-499a-96e8-8aa0aa9479ee tempest-VolumesExtendTest-1954853756 None] jdss extend volume v_e1831ff0-b0ca-4aff-844b-4347d1c326da to 2147483648 {{(pid=73403) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-227ce3ab-3fa1-499a-96e8-8aa0aa9479ee tempest-VolumesExtendTest-1954853756 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-227ce3ab-3fa1-499a-96e8-8aa0aa9479ee tempest-VolumesExtendTest-1954853756 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-227ce3ab-3fa1-499a-96e8-8aa0aa9479ee tempest-VolumesExtendTest-1954853756 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:52 user cinder-volume[73403]: INFO cinder.volume.manager [None req-227ce3ab-3fa1-499a-96e8-8aa0aa9479ee tempest-VolumesExtendTest-1954853756 None] Extend volume completed successfully. Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.coordination [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Acquiring lock "cinder-33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.coordination [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Lock "cinder-33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] remove_export for volume: 33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1443787178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e,launched_at=2023-04-14T02:58:43Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2293bfe7e844bba9c6a043ef04fcf89',provider_auth='CHAP nhCYDqlj 2EdWTJUztp6eAR',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:41Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:58:52Z,updated_at=2023-04-14T02:58:52Z,use_quota=True,user_id='b0f8e76af62c4b03948441942c71f974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] detach volume v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e from target iqn.2010-10.org.openstack:33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e/luns/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e/luns/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e/luns/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e/luns/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] failed to remove resource iqn.2010-10.org.openstack:33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e because of JDSS resource v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] delete target: iqn.2010-10.org.openstack:33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] delete target iqn.2010-10.org.openstack:33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] get volume v_ceda750c-3661-4806-9e27-2013edcf9d2f info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] failed to remove resource iqn.2010-10.org.openstack:33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e because of JDSS resource iqn.2010-10.org.openstack:33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] deleating volume v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] get snapshots for volume v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ceda750c-3661-4806-9e27-2013edcf9d2f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442497', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112511', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13100286985943813019', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'deca40516fecda20', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114287247360', 'san:volume_id': 'deca40516fecda20c2db110493edf85168ffbf2d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84425', 'name': 'v_ceda750c-3661-4806-9e27-2013edcf9d2f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] delete volume:v_ceda750c-3661-4806-9e27-2013edcf9d2f recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] get volume v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442531', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112592', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9113056112056524647', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7fd82709f34a2443', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114287247360', 'san:volume_id': '7fd82709f34a244324fdc3ba76fa43c7b1a56368', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84922', 'name': 'v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] delete volume:v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Acquiring lock "cinder-e1831ff0-b0ca-4aff-844b-4347d1c326da-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Lock "cinder-e1831ff0-b0ca-4aff-844b-4347d1c326da-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] remove_export for volume: e1831ff0-b0ca-4aff-844b-4347d1c326da. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-983686268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e1831ff0-b0ca-4aff-844b-4347d1c326da,launched_at=2023-04-14T02:58:51Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='8bb76473b77e4b15b46580fa5d5d520b',provider_auth='CHAP ZgoqsmAf of7HrjNYSg5eJ9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1831ff0-b0ca-4aff-844b-4347d1c326da 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:30Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:58:53Z,updated_at=2023-04-14T02:58:53Z,use_quota=True,user_id='06244553cd11445084ba0bdb03929f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:e1831ff0-b0ca-4aff-844b-4347d1c326da. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] detach volume v_e1831ff0-b0ca-4aff-844b-4347d1c326da from target iqn.2010-10.org.openstack:e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1831ff0-b0ca-4aff-844b-4347d1c326da/luns/v_e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1831ff0-b0ca-4aff-844b-4347d1c326da/luns/v_e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Flow 'volume_create_manager' (55ecbf6d-7ebb-4ed5-83d0-2695a1fd2564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c92b3a-ea84-4b5f-9eea-ab7c465c2a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c92b3a-ea84-4b5f-9eea-ab7c465c2a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-548150738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=40001442-9c32-44e5-86dc-71ec35fd4146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbe40f2b4274ea58dfc16a77fa670b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:58:54Z,use_quota=True,user_id='2e7714f95bb44256bd10c8b16b6181ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36bd9dd1-c5dd-4684-b791-34b671f6d16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36bd9dd1-c5dd-4684-b791-34b671f6d16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfefcc2-9a31-4099-80e7-32e90add0d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfefcc2-9a31-4099-80e7-32e90add0d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40001442-9c32-44e5-86dc-71ec35fd4146', 'volume_name': 'volume-40001442-9c32-44e5-86dc-71ec35fd4146', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173a7474-c4b3-4029-8d3e-ea8725e61a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173a7474-c4b3-4029-8d3e-ea8725e61a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c772930-d19e-476a-aeff-a7fa9c760cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:53 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Volume 40001442-9c32-44e5-86dc-71ec35fd4146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40001442-9c32-44e5-86dc-71ec35fd4146', 'volume_size': 1} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] creating volume v_40001442-9c32-44e5-86dc-71ec35fd4146. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] create volume {'name': 'v_40001442-9c32-44e5-86dc-71ec35fd4146', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ceda750c-3661-4806-9e27-2013edcf9d2f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] volume v_ceda750c-3661-4806-9e27-2013edcf9d2f deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e1831ff0-b0ca-4aff-844b-4347d1c326da not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1831ff0-b0ca-4aff-844b-4347d1c326da/luns/v_e1831ff0-b0ca-4aff-844b-4347d1c326da'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1831ff0-b0ca-4aff-844b-4347d1c326da/luns/v_e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] failed to remove resource iqn.2010-10.org.openstack:e1831ff0-b0ca-4aff-844b-4347d1c326da because of JDSS resource v_e1831ff0-b0ca-4aff-844b-4347d1c326da DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] delete target: iqn.2010-10.org.openstack:e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] delete target iqn.2010-10.org.openstack:e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.quota [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Created reservations ['1948fa11-5c4f-4b82-8d04-4159bb4030fa', 'ce32717a-19e6-4477-b91e-b8dbfae129d2', '5154d1fc-5381-4980-8b59-89c6ae7fdbd2', '8eaf868c-39de-49ca-aaeb-ea7721cf4c0e'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e1831ff0-b0ca-4aff-844b-4347d1c326da not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1831ff0-b0ca-4aff-844b-4347d1c326da'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] failed to remove resource iqn.2010-10.org.openstack:e1831ff0-b0ca-4aff-844b-4347d1c326da because of JDSS resource iqn.2010-10.org.openstack:e1831ff0-b0ca-4aff-844b-4347d1c326da DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] deleating volume v_e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] get snapshots for volume v_e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1831ff0-b0ca-4aff-844b-4347d1c326da/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1831ff0-b0ca-4aff-844b-4347d1c326da/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_40001442-9c32-44e5-86dc-71ec35fd4146', 'is_clone': False, 'name': 'v_40001442-9c32-44e5-86dc-71ec35fd4146'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c772930-d19e-476a-aeff-a7fa9c760cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40001442-9c32-44e5-86dc-71ec35fd4146', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98130952-2041-47c7-810a-a04488aec18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:54 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Volume volume-40001442-9c32-44e5-86dc-71ec35fd4146 (40001442-9c32-44e5-86dc-71ec35fd4146): created successfully Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98130952-2041-47c7-810a-a04488aec18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Flow 'volume_create_manager' (55ecbf6d-7ebb-4ed5-83d0-2695a1fd2564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:54 user cinder-volume[73403]: INFO cinder.volume.manager [None req-b8a30094-92af-4ac8-a73b-28bf5cf8fcc4 tempest-VolumesSnapshotListTestJSON-1177713420 None] Created volume successfully. Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1831ff0-b0ca-4aff-844b-4347d1c326da/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] get volume v_e1831ff0-b0ca-4aff-844b-4347d1c326da info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] volume v_33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:58:55 user cinder-volume[73403]: DEBUG cinder.quota [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Created reservations ['7b87f2ab-23f1-4d73-96b9-90188b03e99e', 'bccc550b-8925-40e6-a36a-37716bbfb9ce', '1fcbc40b-cd88-4ddb-af48-2fb51bdf06a0', 'd454de9c-7e07-4168-b6d6-170519918042'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Geting {'code': 200, 'error': None, 'data': {'available': '114287316992', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:58:55 user cinder-volume[73403]: DEBUG cinder.manager [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:58:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_e1831ff0-b0ca-4aff-844b-4347d1c326da', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e1831ff0-b0ca-4aff-844b-4347d1c326da', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442539', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '112622', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18401571881186260834', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a65a3e005197d70a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114287316992', 'san:volume_id': 'a65a3e005197d70a2541365a03f5a8266a7b6647', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84302', 'name': 'v_e1831ff0-b0ca-4aff-844b-4347d1c326da', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] delete snapshot v_e1831ff0-b0ca-4aff-844b-4347d1c326da of volume v_482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:58:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:55 user cinder-volume[73403]: INFO cinder.volume.manager [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Deleted volume successfully. Apr 14 02:58:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:58:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:58:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:55 user cinder-volume[73403]: DEBUG cinder.coordination [None req-81f3e491-820b-468a-bba9-e926a0478b18 tempest-SnapshotsActionsTest-1419620875 None] Lock "cinder-ceda750c-3661-4806-9e27-2013edcf9d2f-delete_volume" released by "delete_volume" :: held 5.630s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:58:56 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=51,cinder:INSERT=11,cinder:UPDATE=37,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e3f9fa5b-61f3-4f6d-b884-86c1d9c026c3 tempest-VolumesSnapshotListTestJSON-1177713420 None] create snapshot adb8f82e-f028-4bf1-8f22-89448f3c9a90 for volume 40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:58:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e3f9fa5b-61f3-4f6d-b884-86c1d9c026c3 tempest-VolumesSnapshotListTestJSON-1177713420 None] cloning v_40001442-9c32-44e5-86dc-71ec35fd4146 to s_adb8f82e-f028-4bf1-8f22-89448f3c9a90 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:58:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e3f9fa5b-61f3-4f6d-b884-86c1d9c026c3 tempest-VolumesSnapshotListTestJSON-1177713420 None] create snapshot s_adb8f82e-f028-4bf1-8f22-89448f3c9a90 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:58:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3f9fa5b-61f3-4f6d-b884-86c1d9c026c3 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3f9fa5b-61f3-4f6d-b884-86c1d9c026c3 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_e1831ff0-b0ca-4aff-844b-4347d1c326da {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] snapshot v_e1831ff0-b0ca-4aff-844b-4347d1c326da deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=55,cinder:INSERT=8,cinder:UPDATE=34,cinder:DELETE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.quota [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Created reservations ['e6174334-b384-472f-be4c-7e880ee29b88', 'ed45636a-f6f5-4548-8aef-8fec776f1291', 'e82ab0a1-d924-461a-8f9d-5ac0222c1388', 'b53ad591-e651-40d7-ab01-40792718f604'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3f9fa5b-61f3-4f6d-b884-86c1d9c026c3 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_adb8f82e-f028-4bf1-8f22-89448f3c9a90'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e3f9fa5b-61f3-4f6d-b884-86c1d9c026c3 tempest-VolumesSnapshotListTestJSON-1177713420 None] create volume s_adb8f82e-f028-4bf1-8f22-89448f3c9a90 from snapshot s_adb8f82e-f028-4bf1-8f22-89448f3c9a90 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3f9fa5b-61f3-4f6d-b884-86c1d9c026c3 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3f9fa5b-61f3-4f6d-b884-86c1d9c026c3 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Flow 'volume_create_manager' (5b45a3d4-6c80-44cb-bedd-0aad989b3f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1f41f9-4bc2-4bba-9b23-c5e7f1c39a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1f41f9-4bc2-4bba-9b23-c5e7f1c39a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1635923746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4bb2b465-cd73-4fbf-b36d-c567847be6e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6cff3c7bf594168b9e268273d86d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:58:57Z,use_quota=True,user_id='e155c5f303474113b00e1eaa65588866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1646f8aa-b2b4-42f7-9689-b934600cdd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1646f8aa-b2b4-42f7-9689-b934600cdd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19ea596-af67-4ea3-bc93-54d6ffbe2e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19ea596-af67-4ea3-bc93-54d6ffbe2e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bb2b465-cd73-4fbf-b36d-c567847be6e3', 'volume_name': 'volume-4bb2b465-cd73-4fbf-b36d-c567847be6e3', 'volume_size': 2}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be74d5b3-cf6e-413e-8058-66075631de29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be74d5b3-cf6e-413e-8058-66075631de29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (908db367-135a-48fd-8854-95ab181b7ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:57 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Volume 4bb2b465-cd73-4fbf-b36d-c567847be6e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bb2b465-cd73-4fbf-b36d-c567847be6e3', 'volume_size': 2} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] creating volume v_4bb2b465-cd73-4fbf-b36d-c567847be6e3. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] create volume {'name': 'v_4bb2b465-cd73-4fbf-b36d-c567847be6e3', 'size': '2147483648', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Geting {'code': 200, 'error': None, 'data': {'available': '114287316992', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.manager [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:58:57 user cinder-volume[73403]: INFO cinder.volume.manager [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Deleted volume successfully. Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7c100d95-f1bd-490c-8644-1350330d6704 tempest-VolumesExtendTest-1954853756 None] Lock "cinder-e1831ff0-b0ca-4aff-844b-4347d1c326da-delete_volume" released by "delete_volume" :: held 4.089s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Geting {'code': 200, 'error': None, 'data': {'available': '114287423488', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.manager [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:58:57 user cinder-volume[73403]: INFO cinder.volume.manager [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Deleted volume successfully. Apr 14 02:58:57 user cinder-volume[73403]: DEBUG cinder.coordination [None req-da884973-dc98-4013-9a8e-b6dc7f904410 tempest-SnapshotMetadataTestJSON-1572189114 None] Lock "cinder-33cd4fa9-f6f0-4a40-8b29-894e9dd4b21e-delete_volume" released by "delete_volume" :: held 5.565s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Flow 'volume_create_manager' (61b14893-1e01-417c-8bed-35b02e23eab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (978a29d2-a359-4d2b-9889-ca0cc5f9b17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3f9fa5b-61f3-4f6d-b884-86c1d9c026c3 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_40001442-9c32-44e5-86dc-71ec35fd4146@s_adb8f82e-f028-4bf1-8f22-89448f3c9a90', 'is_clone': True, 'full_name': 'Pool-0/s_adb8f82e-f028-4bf1-8f22-89448f3c9a90', 'name': 's_adb8f82e-f028-4bf1-8f22-89448f3c9a90'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3f9fa5b-61f3-4f6d-b884-86c1d9c026c3 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_adb8f82e-f028-4bf1-8f22-89448f3c9a90/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3f9fa5b-61f3-4f6d-b884-86c1d9c026c3 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_adb8f82e-f028-4bf1-8f22-89448f3c9a90/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (978a29d2-a359-4d2b-9889-ca0cc5f9b17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1584625537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0356ebbf-a388-4461-8bde-93f520cbd314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb76473b77e4b15b46580fa5d5d520b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:58:58Z,use_quota=True,user_id='06244553cd11445084ba0bdb03929f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e40b5e-8104-40cb-b854-e7e3cfea2526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e40b5e-8104-40cb-b854-e7e3cfea2526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffdaab44-9210-40a6-a3fe-e3f8c108f882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffdaab44-9210-40a6-a3fe-e3f8c108f882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0356ebbf-a388-4461-8bde-93f520cbd314', 'volume_name': 'volume-0356ebbf-a388-4461-8bde-93f520cbd314', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c5325a-2f94-4488-ae7c-4bedd8989179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c5325a-2f94-4488-ae7c-4bedd8989179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c86abd0-41bd-46cd-b04b-9c196126ed8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:58 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Volume 0356ebbf-a388-4461-8bde-93f520cbd314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0356ebbf-a388-4461-8bde-93f520cbd314', 'volume_size': 1} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] creating volume v_0356ebbf-a388-4461-8bde-93f520cbd314. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] create volume {'name': 'v_0356ebbf-a388-4461-8bde-93f520cbd314', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3f9fa5b-61f3-4f6d-b884-86c1d9c026c3 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_adb8f82e-f028-4bf1-8f22-89448f3c9a90/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e3f9fa5b-61f3-4f6d-b884-86c1d9c026c3 tempest-VolumesSnapshotListTestJSON-1177713420 None] volume s_adb8f82e-f028-4bf1-8f22-89448f3c9a90 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:58:58 user cinder-volume[73403]: INFO cinder.volume.manager [None req-e3f9fa5b-61f3-4f6d-b884-86c1d9c026c3 tempest-VolumesSnapshotListTestJSON-1177713420 None] Create snapshot completed successfully Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_4bb2b465-cd73-4fbf-b36d-c567847be6e3', 'is_clone': False, 'name': 'v_4bb2b465-cd73-4fbf-b36d-c567847be6e3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (908db367-135a-48fd-8854-95ab181b7ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bb2b465-cd73-4fbf-b36d-c567847be6e3', 'volume_size': 2}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f566c3-8cdd-4b8a-8c6e-6edc7b924994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:58 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Volume volume-4bb2b465-cd73-4fbf-b36d-c567847be6e3 (4bb2b465-cd73-4fbf-b36d-c567847be6e3): created successfully Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f566c3-8cdd-4b8a-8c6e-6edc7b924994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Flow 'volume_create_manager' (5b45a3d4-6c80-44cb-bedd-0aad989b3f33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:58 user cinder-volume[73403]: INFO cinder.volume.manager [None req-6ec7c1db-1f86-4ac4-9ffb-3a37cb2560e9 tempest-VolumesCloneNegativeTest-26228563 None] Created volume successfully. Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56caa66f-9300-4143-977f-9873ccce3c14 tempest-VolumesSnapshotListTestJSON-1177713420 None] create snapshot e3044241-3530-492e-afa1-c8820982a482 for volume 40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-56caa66f-9300-4143-977f-9873ccce3c14 tempest-VolumesSnapshotListTestJSON-1177713420 None] cloning v_40001442-9c32-44e5-86dc-71ec35fd4146 to s_e3044241-3530-492e-afa1-c8820982a482 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56caa66f-9300-4143-977f-9873ccce3c14 tempest-VolumesSnapshotListTestJSON-1177713420 None] create snapshot s_e3044241-3530-492e-afa1-c8820982a482 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56caa66f-9300-4143-977f-9873ccce3c14 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56caa66f-9300-4143-977f-9873ccce3c14 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Acquiring lock "cinder-4bb2b465-cd73-4fbf-b36d-c567847be6e3-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Lock "cinder-4bb2b465-cd73-4fbf-b36d-c567847be6e3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] remove_export for volume: 4bb2b465-cd73-4fbf-b36d-c567847be6e3. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1635923746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4bb2b465-cd73-4fbf-b36d-c567847be6e3,launched_at=2023-04-14T02:58:59Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6cff3c7bf594168b9e268273d86d058',provider_auth='CHAP VrpwcTKY dZr4eTbK7g9M5y',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bb2b465-cd73-4fbf-b36d-c567847be6e3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:57Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:59:00Z,updated_at=2023-04-14T02:59:00Z,use_quota=True,user_id='e155c5f303474113b00e1eaa65588866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:4bb2b465-cd73-4fbf-b36d-c567847be6e3. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] detach volume v_4bb2b465-cd73-4fbf-b36d-c567847be6e3 from target iqn.2010-10.org.openstack:4bb2b465-cd73-4fbf-b36d-c567847be6e3 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4bb2b465-cd73-4fbf-b36d-c567847be6e3/luns/v_4bb2b465-cd73-4fbf-b36d-c567847be6e3 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4bb2b465-cd73-4fbf-b36d-c567847be6e3/luns/v_4bb2b465-cd73-4fbf-b36d-c567847be6e3 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4bb2b465-cd73-4fbf-b36d-c567847be6e3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4bb2b465-cd73-4fbf-b36d-c567847be6e3/luns/v_4bb2b465-cd73-4fbf-b36d-c567847be6e3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4bb2b465-cd73-4fbf-b36d-c567847be6e3/luns/v_4bb2b465-cd73-4fbf-b36d-c567847be6e3 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] failed to remove resource iqn.2010-10.org.openstack:4bb2b465-cd73-4fbf-b36d-c567847be6e3 because of JDSS resource v_4bb2b465-cd73-4fbf-b36d-c567847be6e3 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] delete target: iqn.2010-10.org.openstack:4bb2b465-cd73-4fbf-b36d-c567847be6e3 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] delete target iqn.2010-10.org.openstack:4bb2b465-cd73-4fbf-b36d-c567847be6e3 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4bb2b465-cd73-4fbf-b36d-c567847be6e3 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4bb2b465-cd73-4fbf-b36d-c567847be6e3 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_0356ebbf-a388-4461-8bde-93f520cbd314', 'is_clone': False, 'name': 'v_0356ebbf-a388-4461-8bde-93f520cbd314'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c86abd0-41bd-46cd-b04b-9c196126ed8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0356ebbf-a388-4461-8bde-93f520cbd314', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b03e24-530d-48a4-b1ae-c11828a7d40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4bb2b465-cd73-4fbf-b36d-c567847be6e3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4bb2b465-cd73-4fbf-b36d-c567847be6e3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4bb2b465-cd73-4fbf-b36d-c567847be6e3 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] failed to remove resource iqn.2010-10.org.openstack:4bb2b465-cd73-4fbf-b36d-c567847be6e3 because of JDSS resource iqn.2010-10.org.openstack:4bb2b465-cd73-4fbf-b36d-c567847be6e3 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] deleating volume v_4bb2b465-cd73-4fbf-b36d-c567847be6e3 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] get snapshots for volume v_4bb2b465-cd73-4fbf-b36d-c567847be6e3 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4bb2b465-cd73-4fbf-b36d-c567847be6e3/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4bb2b465-cd73-4fbf-b36d-c567847be6e3/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:58:59 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Volume volume-0356ebbf-a388-4461-8bde-93f520cbd314 (0356ebbf-a388-4461-8bde-93f520cbd314): created successfully Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b03e24-530d-48a4-b1ae-c11828a7d40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:58:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Flow 'volume_create_manager' (61b14893-1e01-417c-8bed-35b02e23eab9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:58:59 user cinder-volume[73403]: INFO cinder.volume.manager [None req-d359bcbe-a63f-4766-a47b-83baeb7a6d93 tempest-VolumesExtendTest-1954853756 None] Created volume successfully. Apr 14 02:59:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4bb2b465-cd73-4fbf-b36d-c567847be6e3/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] get volume v_4bb2b465-cd73-4fbf-b36d-c567847be6e3 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:59:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4bb2b465-cd73-4fbf-b36d-c567847be6e3 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4bb2b465-cd73-4fbf-b36d-c567847be6e3 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4bb2b465-cd73-4fbf-b36d-c567847be6e3', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442547', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112649', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5095757654500705100', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '63918532efcc9bb5', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114287259648', 'san:volume_id': '63918532efcc9bb567730d6bb1624e7c1db0bd25', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84019', 'name': 'v_4bb2b465-cd73-4fbf-b36d-c567847be6e3', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4bb2b465-cd73-4fbf-b36d-c567847be6e3 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] delete volume:v_4bb2b465-cd73-4fbf-b36d-c567847be6e3 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:59:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4bb2b465-cd73-4fbf-b36d-c567847be6e3 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4bb2b465-cd73-4fbf-b36d-c567847be6e3 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6681226b-5177-49f6-968d-6aa989e4a1f1 tempest-VolumesExtendTest-1954853756 None] create snapshot b3fe6330-eb44-437f-9e29-d91316b318fa for volume 0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:59:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6681226b-5177-49f6-968d-6aa989e4a1f1 tempest-VolumesExtendTest-1954853756 None] cloning v_0356ebbf-a388-4461-8bde-93f520cbd314 to s_b3fe6330-eb44-437f-9e29-d91316b318fa {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:59:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6681226b-5177-49f6-968d-6aa989e4a1f1 tempest-VolumesExtendTest-1954853756 None] create snapshot s_b3fe6330-eb44-437f-9e29-d91316b318fa {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:59:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6681226b-5177-49f6-968d-6aa989e4a1f1 tempest-VolumesExtendTest-1954853756 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6681226b-5177-49f6-968d-6aa989e4a1f1 tempest-VolumesExtendTest-1954853756 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56caa66f-9300-4143-977f-9873ccce3c14 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_e3044241-3530-492e-afa1-c8820982a482'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56caa66f-9300-4143-977f-9873ccce3c14 tempest-VolumesSnapshotListTestJSON-1177713420 None] create volume s_e3044241-3530-492e-afa1-c8820982a482 from snapshot s_e3044241-3530-492e-afa1-c8820982a482 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:59:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56caa66f-9300-4143-977f-9873ccce3c14 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56caa66f-9300-4143-977f-9873ccce3c14 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6681226b-5177-49f6-968d-6aa989e4a1f1 tempest-VolumesExtendTest-1954853756 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_b3fe6330-eb44-437f-9e29-d91316b318fa'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6681226b-5177-49f6-968d-6aa989e4a1f1 tempest-VolumesExtendTest-1954853756 None] create volume s_b3fe6330-eb44-437f-9e29-d91316b318fa from snapshot s_b3fe6330-eb44-437f-9e29-d91316b318fa {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:59:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6681226b-5177-49f6-968d-6aa989e4a1f1 tempest-VolumesExtendTest-1954853756 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6681226b-5177-49f6-968d-6aa989e4a1f1 tempest-VolumesExtendTest-1954853756 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4bb2b465-cd73-4fbf-b36d-c567847be6e3 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] volume v_4bb2b465-cd73-4fbf-b36d-c567847be6e3 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:59:01 user cinder-volume[73403]: DEBUG cinder.quota [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Created reservations ['67d1d7b5-df7b-4963-a2b7-e30c732dc9f0', 'f1feebe3-83f9-4e04-befa-ebc3489ecd47', 'b3caefd6-4966-4423-a5cd-e8f772d42b95', 'bca50f73-a018-4459-a9e8-19d0eb0b9eb2'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:59:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:59:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:59:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56caa66f-9300-4143-977f-9873ccce3c14 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_40001442-9c32-44e5-86dc-71ec35fd4146@s_e3044241-3530-492e-afa1-c8820982a482', 'is_clone': True, 'full_name': 'Pool-0/s_e3044241-3530-492e-afa1-c8820982a482', 'name': 's_e3044241-3530-492e-afa1-c8820982a482'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56caa66f-9300-4143-977f-9873ccce3c14 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e3044241-3530-492e-afa1-c8820982a482/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56caa66f-9300-4143-977f-9873ccce3c14 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e3044241-3530-492e-afa1-c8820982a482/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Geting {'code': 200, 'error': None, 'data': {'available': '114287292416', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:59:02 user cinder-volume[73403]: DEBUG cinder.manager [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:59:02 user cinder-volume[73403]: INFO cinder.volume.manager [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Deleted volume successfully. Apr 14 02:59:02 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c11e9206-b62c-4152-8254-dd222677f691 tempest-VolumesCloneNegativeTest-26228563 None] Lock "cinder-4bb2b465-cd73-4fbf-b36d-c567847be6e3-delete_volume" released by "delete_volume" :: held 3.120s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:59:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 02:59:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:59:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:59:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6681226b-5177-49f6-968d-6aa989e4a1f1 tempest-VolumesExtendTest-1954853756 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_0356ebbf-a388-4461-8bde-93f520cbd314@s_b3fe6330-eb44-437f-9e29-d91316b318fa', 'is_clone': True, 'full_name': 'Pool-0/s_b3fe6330-eb44-437f-9e29-d91316b318fa', 'name': 's_b3fe6330-eb44-437f-9e29-d91316b318fa'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6681226b-5177-49f6-968d-6aa989e4a1f1 tempest-VolumesExtendTest-1954853756 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b3fe6330-eb44-437f-9e29-d91316b318fa/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6681226b-5177-49f6-968d-6aa989e4a1f1 tempest-VolumesExtendTest-1954853756 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b3fe6330-eb44-437f-9e29-d91316b318fa/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-56caa66f-9300-4143-977f-9873ccce3c14 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e3044241-3530-492e-afa1-c8820982a482/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-56caa66f-9300-4143-977f-9873ccce3c14 tempest-VolumesSnapshotListTestJSON-1177713420 None] volume s_e3044241-3530-492e-afa1-c8820982a482 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:59:03 user cinder-volume[73403]: INFO cinder.volume.manager [None req-56caa66f-9300-4143-977f-9873ccce3c14 tempest-VolumesSnapshotListTestJSON-1177713420 None] Create snapshot completed successfully Apr 14 02:59:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6681226b-5177-49f6-968d-6aa989e4a1f1 tempest-VolumesExtendTest-1954853756 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b3fe6330-eb44-437f-9e29-d91316b318fa/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6681226b-5177-49f6-968d-6aa989e4a1f1 tempest-VolumesExtendTest-1954853756 None] volume s_b3fe6330-eb44-437f-9e29-d91316b318fa properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:59:03 user cinder-volume[73403]: INFO cinder.volume.manager [None req-6681226b-5177-49f6-968d-6aa989e4a1f1 tempest-VolumesExtendTest-1954853756 None] Create snapshot completed successfully Apr 14 02:59:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114287267840', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:59:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:59:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5cdaa856-6b5d-4303-88ef-ed2a2d9441c6 tempest-VolumesExtendTest-1954853756 None] Extend volume 0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}} Apr 14 02:59:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5cdaa856-6b5d-4303-88ef-ed2a2d9441c6 tempest-VolumesExtendTest-1954853756 None] jdss extend volume v_0356ebbf-a388-4461-8bde-93f520cbd314 to 2147483648 {{(pid=73403) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}} Apr 14 02:59:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cdaa856-6b5d-4303-88ef-ed2a2d9441c6 tempest-VolumesExtendTest-1954853756 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cdaa856-6b5d-4303-88ef-ed2a2d9441c6 tempest-VolumesExtendTest-1954853756 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cdaa856-6b5d-4303-88ef-ed2a2d9441c6 tempest-VolumesExtendTest-1954853756 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:05 user cinder-volume[73403]: INFO cinder.volume.manager [None req-5cdaa856-6b5d-4303-88ef-ed2a2d9441c6 tempest-VolumesExtendTest-1954853756 None] Extend volume completed successfully. Apr 14 02:59:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a85696bf-b8cf-4612-adfe-75ec2be6e459 tempest-VolumesSnapshotListTestJSON-1177713420 None] create snapshot 620b86ea-d79d-4eca-9329-bafdc9e9051c for volume 40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:59:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a85696bf-b8cf-4612-adfe-75ec2be6e459 tempest-VolumesSnapshotListTestJSON-1177713420 None] cloning v_40001442-9c32-44e5-86dc-71ec35fd4146 to s_620b86ea-d79d-4eca-9329-bafdc9e9051c {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:59:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a85696bf-b8cf-4612-adfe-75ec2be6e459 tempest-VolumesSnapshotListTestJSON-1177713420 None] create snapshot s_620b86ea-d79d-4eca-9329-bafdc9e9051c {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:59:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a85696bf-b8cf-4612-adfe-75ec2be6e459 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a85696bf-b8cf-4612-adfe-75ec2be6e459 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:05 user cinder-volume[73403]: DEBUG cinder.coordination [None req-0f977bd2-e4bd-4093-a28d-5282584c2454 tempest-VolumesExtendTest-1954853756 None] Acquiring lock "cinder-b3fe6330-eb44-437f-9e29-d91316b318fa-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:59:05 user cinder-volume[73403]: DEBUG cinder.coordination [None req-0f977bd2-e4bd-4093-a28d-5282584c2454 tempest-VolumesExtendTest-1954853756 None] Lock "cinder-b3fe6330-eb44-437f-9e29-d91316b318fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:59:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0f977bd2-e4bd-4093-a28d-5282584c2454 tempest-VolumesExtendTest-1954853756 None] deleating snapshot s_b3fe6330-eb44-437f-9e29-d91316b318fa. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:59:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0f977bd2-e4bd-4093-a28d-5282584c2454 tempest-VolumesExtendTest-1954853756 None] get snapshots for volume s_b3fe6330-eb44-437f-9e29-d91316b318fa {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:59:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f977bd2-e4bd-4093-a28d-5282584c2454 tempest-VolumesExtendTest-1954853756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b3fe6330-eb44-437f-9e29-d91316b318fa/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f977bd2-e4bd-4093-a28d-5282584c2454 tempest-VolumesExtendTest-1954853756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b3fe6330-eb44-437f-9e29-d91316b318fa/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a85696bf-b8cf-4612-adfe-75ec2be6e459 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_620b86ea-d79d-4eca-9329-bafdc9e9051c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a85696bf-b8cf-4612-adfe-75ec2be6e459 tempest-VolumesSnapshotListTestJSON-1177713420 None] create volume s_620b86ea-d79d-4eca-9329-bafdc9e9051c from snapshot s_620b86ea-d79d-4eca-9329-bafdc9e9051c {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:59:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a85696bf-b8cf-4612-adfe-75ec2be6e459 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a85696bf-b8cf-4612-adfe-75ec2be6e459 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f977bd2-e4bd-4093-a28d-5282584c2454 tempest-VolumesExtendTest-1954853756 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b3fe6330-eb44-437f-9e29-d91316b318fa/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0f977bd2-e4bd-4093-a28d-5282584c2454 tempest-VolumesExtendTest-1954853756 None] get volume s_b3fe6330-eb44-437f-9e29-d91316b318fa info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:59:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f977bd2-e4bd-4093-a28d-5282584c2454 tempest-VolumesExtendTest-1954853756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b3fe6330-eb44-437f-9e29-d91316b318fa {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f977bd2-e4bd-4093-a28d-5282584c2454 tempest-VolumesExtendTest-1954853756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b3fe6330-eb44-437f-9e29-d91316b318fa {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f977bd2-e4bd-4093-a28d-5282584c2454 tempest-VolumesExtendTest-1954853756 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_0356ebbf-a388-4461-8bde-93f520cbd314@s_b3fe6330-eb44-437f-9e29-d91316b318fa', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_b3fe6330-eb44-437f-9e29-d91316b318fa', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442551', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112665', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10536889171992388131', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '48897e0bcda671e4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114287161344', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '82171', 'name': 's_b3fe6330-eb44-437f-9e29-d91316b318fa', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b3fe6330-eb44-437f-9e29-d91316b318fa {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0f977bd2-e4bd-4093-a28d-5282584c2454 tempest-VolumesExtendTest-1954853756 None] delete snapshot s_b3fe6330-eb44-437f-9e29-d91316b318fa of volume v_0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:59:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f977bd2-e4bd-4093-a28d-5282584c2454 tempest-VolumesExtendTest-1954853756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314/snapshots/s_b3fe6330-eb44-437f-9e29-d91316b318fa {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f977bd2-e4bd-4093-a28d-5282584c2454 tempest-VolumesExtendTest-1954853756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314/snapshots/s_b3fe6330-eb44-437f-9e29-d91316b318fa {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a85696bf-b8cf-4612-adfe-75ec2be6e459 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_40001442-9c32-44e5-86dc-71ec35fd4146@s_620b86ea-d79d-4eca-9329-bafdc9e9051c', 'is_clone': True, 'full_name': 'Pool-0/s_620b86ea-d79d-4eca-9329-bafdc9e9051c', 'name': 's_620b86ea-d79d-4eca-9329-bafdc9e9051c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a85696bf-b8cf-4612-adfe-75ec2be6e459 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_620b86ea-d79d-4eca-9329-bafdc9e9051c/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a85696bf-b8cf-4612-adfe-75ec2be6e459 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_620b86ea-d79d-4eca-9329-bafdc9e9051c/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a85696bf-b8cf-4612-adfe-75ec2be6e459 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_620b86ea-d79d-4eca-9329-bafdc9e9051c/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a85696bf-b8cf-4612-adfe-75ec2be6e459 tempest-VolumesSnapshotListTestJSON-1177713420 None] volume s_620b86ea-d79d-4eca-9329-bafdc9e9051c properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:59:07 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a85696bf-b8cf-4612-adfe-75ec2be6e459 tempest-VolumesSnapshotListTestJSON-1177713420 None] Create snapshot completed successfully Apr 14 02:59:07 user cinder-volume[73403]: DEBUG cinder.coordination [None req-446d3a69-0d70-441f-812b-86253d9dd6b9 tempest-VolumesSnapshotListTestJSON-1177713420 None] Acquiring lock "cinder-620b86ea-d79d-4eca-9329-bafdc9e9051c-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:59:07 user cinder-volume[73403]: DEBUG cinder.coordination [None req-446d3a69-0d70-441f-812b-86253d9dd6b9 tempest-VolumesSnapshotListTestJSON-1177713420 None] Lock "cinder-620b86ea-d79d-4eca-9329-bafdc9e9051c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:59:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-446d3a69-0d70-441f-812b-86253d9dd6b9 tempest-VolumesSnapshotListTestJSON-1177713420 None] deleating snapshot s_620b86ea-d79d-4eca-9329-bafdc9e9051c. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:59:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-446d3a69-0d70-441f-812b-86253d9dd6b9 tempest-VolumesSnapshotListTestJSON-1177713420 None] get snapshots for volume s_620b86ea-d79d-4eca-9329-bafdc9e9051c {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:59:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446d3a69-0d70-441f-812b-86253d9dd6b9 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_620b86ea-d79d-4eca-9329-bafdc9e9051c/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446d3a69-0d70-441f-812b-86253d9dd6b9 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_620b86ea-d79d-4eca-9329-bafdc9e9051c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f977bd2-e4bd-4093-a28d-5282584c2454 tempest-VolumesExtendTest-1954853756 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314/snapshots/s_b3fe6330-eb44-437f-9e29-d91316b318fa {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0f977bd2-e4bd-4093-a28d-5282584c2454 tempest-VolumesExtendTest-1954853756 None] snapshot s_b3fe6330-eb44-437f-9e29-d91316b318fa deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:59:08 user cinder-volume[73403]: DEBUG cinder.quota [None req-0f977bd2-e4bd-4093-a28d-5282584c2454 tempest-VolumesExtendTest-1954853756 None] Created reservations ['dfe40718-0611-4cf2-b7ab-e6d83e353fba', '72863a2b-19c9-484f-93c0-e2fc4228c8b7', 'cac10945-403f-4b07-a902-3cad7dceed38', '3538d5b2-5035-4afe-9720-15ef1f513fcf'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:59:08 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=59,cinder:INSERT=6,cinder:UPDATE=30,cinder:DELETE=5 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:08 user cinder-volume[73403]: INFO cinder.volume.manager [None req-0f977bd2-e4bd-4093-a28d-5282584c2454 tempest-VolumesExtendTest-1954853756 None] Delete snapshot completed successfully. Apr 14 02:59:08 user cinder-volume[73403]: DEBUG cinder.coordination [None req-0f977bd2-e4bd-4093-a28d-5282584c2454 tempest-VolumesExtendTest-1954853756 None] Lock "cinder-b3fe6330-eb44-437f-9e29-d91316b318fa-delete_snapshot" released by "delete_snapshot" :: held 2.304s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:59:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446d3a69-0d70-441f-812b-86253d9dd6b9 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_620b86ea-d79d-4eca-9329-bafdc9e9051c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-446d3a69-0d70-441f-812b-86253d9dd6b9 tempest-VolumesSnapshotListTestJSON-1177713420 None] get volume s_620b86ea-d79d-4eca-9329-bafdc9e9051c info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:59:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446d3a69-0d70-441f-812b-86253d9dd6b9 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_620b86ea-d79d-4eca-9329-bafdc9e9051c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446d3a69-0d70-441f-812b-86253d9dd6b9 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_620b86ea-d79d-4eca-9329-bafdc9e9051c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446d3a69-0d70-441f-812b-86253d9dd6b9 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_40001442-9c32-44e5-86dc-71ec35fd4146@s_620b86ea-d79d-4eca-9329-bafdc9e9051c', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_620b86ea-d79d-4eca-9329-bafdc9e9051c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442555', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112674', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5234289619356773157', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd7acb09949cac55a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114287243264', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '83198', 'name': 's_620b86ea-d79d-4eca-9329-bafdc9e9051c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_620b86ea-d79d-4eca-9329-bafdc9e9051c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-446d3a69-0d70-441f-812b-86253d9dd6b9 tempest-VolumesSnapshotListTestJSON-1177713420 None] delete snapshot s_620b86ea-d79d-4eca-9329-bafdc9e9051c of volume v_40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:59:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446d3a69-0d70-441f-812b-86253d9dd6b9 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots/s_620b86ea-d79d-4eca-9329-bafdc9e9051c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446d3a69-0d70-441f-812b-86253d9dd6b9 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots/s_620b86ea-d79d-4eca-9329-bafdc9e9051c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.coordination [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Acquiring lock "cinder-0356ebbf-a388-4461-8bde-93f520cbd314-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.coordination [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Lock "cinder-0356ebbf-a388-4461-8bde-93f520cbd314-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] remove_export for volume: 0356ebbf-a388-4461-8bde-93f520cbd314. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1584625537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0356ebbf-a388-4461-8bde-93f520cbd314,launched_at=2023-04-14T02:59:00Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='8bb76473b77e4b15b46580fa5d5d520b',provider_auth='CHAP zDkWfHoL UF84g9Ms1Sio2x',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0356ebbf-a388-4461-8bde-93f520cbd314 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:58Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:59:09Z,updated_at=2023-04-14T02:59:09Z,use_quota=True,user_id='06244553cd11445084ba0bdb03929f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:0356ebbf-a388-4461-8bde-93f520cbd314. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] detach volume v_0356ebbf-a388-4461-8bde-93f520cbd314 from target iqn.2010-10.org.openstack:0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0356ebbf-a388-4461-8bde-93f520cbd314/luns/v_0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0356ebbf-a388-4461-8bde-93f520cbd314/luns/v_0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0356ebbf-a388-4461-8bde-93f520cbd314 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0356ebbf-a388-4461-8bde-93f520cbd314/luns/v_0356ebbf-a388-4461-8bde-93f520cbd314'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0356ebbf-a388-4461-8bde-93f520cbd314/luns/v_0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] failed to remove resource iqn.2010-10.org.openstack:0356ebbf-a388-4461-8bde-93f520cbd314 because of JDSS resource v_0356ebbf-a388-4461-8bde-93f520cbd314 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] delete target: iqn.2010-10.org.openstack:0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] delete target iqn.2010-10.org.openstack:0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0356ebbf-a388-4461-8bde-93f520cbd314 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0356ebbf-a388-4461-8bde-93f520cbd314'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] failed to remove resource iqn.2010-10.org.openstack:0356ebbf-a388-4461-8bde-93f520cbd314 because of JDSS resource iqn.2010-10.org.openstack:0356ebbf-a388-4461-8bde-93f520cbd314 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] deleating volume v_0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] get snapshots for volume v_0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] get volume v_0356ebbf-a388-4461-8bde-93f520cbd314 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_0356ebbf-a388-4461-8bde-93f520cbd314', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442548', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112653', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18086724762664690786', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c2705fdfdd540262', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114287255552', 'san:volume_id': 'c2705fdfdd540262266b2fe3febeeee479935c84', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84028', 'name': 'v_0356ebbf-a388-4461-8bde-93f520cbd314', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] delete volume:v_0356ebbf-a388-4461-8bde-93f520cbd314 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-446d3a69-0d70-441f-812b-86253d9dd6b9 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots/s_620b86ea-d79d-4eca-9329-bafdc9e9051c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-446d3a69-0d70-441f-812b-86253d9dd6b9 tempest-VolumesSnapshotListTestJSON-1177713420 None] snapshot s_620b86ea-d79d-4eca-9329-bafdc9e9051c deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:59:10 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=58,cinder:UPDATE=34,cinder:DELETE=4,cinder:INSERT=4 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:10 user cinder-volume[73403]: DEBUG cinder.quota [None req-446d3a69-0d70-441f-812b-86253d9dd6b9 tempest-VolumesSnapshotListTestJSON-1177713420 None] Created reservations ['77161811-682c-48aa-bc4d-04f2fb9fd0fd', '68463fac-8869-4679-8702-00c3149783d4', '5cd7da6e-3297-4467-8d7e-ad4478343322', '35d5c290-6f5b-4fcf-b6ec-87e8a39579b6'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:59:10 user cinder-volume[73403]: INFO cinder.volume.manager [None req-446d3a69-0d70-441f-812b-86253d9dd6b9 tempest-VolumesSnapshotListTestJSON-1177713420 None] Delete snapshot completed successfully. Apr 14 02:59:10 user cinder-volume[73403]: DEBUG cinder.coordination [None req-446d3a69-0d70-441f-812b-86253d9dd6b9 tempest-VolumesSnapshotListTestJSON-1177713420 None] Lock "cinder-620b86ea-d79d-4eca-9329-bafdc9e9051c-delete_snapshot" released by "delete_snapshot" :: held 2.281s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.coordination [None req-2c69c6af-d416-49dc-818c-46b7b4838966 tempest-VolumesSnapshotListTestJSON-1177713420 None] Acquiring lock "cinder-e3044241-3530-492e-afa1-c8820982a482-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.coordination [None req-2c69c6af-d416-49dc-818c-46b7b4838966 tempest-VolumesSnapshotListTestJSON-1177713420 None] Lock "cinder-e3044241-3530-492e-afa1-c8820982a482-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2c69c6af-d416-49dc-818c-46b7b4838966 tempest-VolumesSnapshotListTestJSON-1177713420 None] deleating snapshot s_e3044241-3530-492e-afa1-c8820982a482. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2c69c6af-d416-49dc-818c-46b7b4838966 tempest-VolumesSnapshotListTestJSON-1177713420 None] get snapshots for volume s_e3044241-3530-492e-afa1-c8820982a482 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c69c6af-d416-49dc-818c-46b7b4838966 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e3044241-3530-492e-afa1-c8820982a482/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c69c6af-d416-49dc-818c-46b7b4838966 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e3044241-3530-492e-afa1-c8820982a482/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0356ebbf-a388-4461-8bde-93f520cbd314 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] volume v_0356ebbf-a388-4461-8bde-93f520cbd314 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.quota [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Created reservations ['e5b31836-64b3-489f-8fa9-9cafcb7eca50', 'f7e58535-fe1b-4041-a63b-1510001038c1', '04108c55-a97c-4e1e-886a-db099df8ead7', 'dedfc3c9-d8af-4ec2-a8af-6bb09d8985f5'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c69c6af-d416-49dc-818c-46b7b4838966 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e3044241-3530-492e-afa1-c8820982a482/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2c69c6af-d416-49dc-818c-46b7b4838966 tempest-VolumesSnapshotListTestJSON-1177713420 None] get volume s_e3044241-3530-492e-afa1-c8820982a482 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c69c6af-d416-49dc-818c-46b7b4838966 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e3044241-3530-492e-afa1-c8820982a482 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c69c6af-d416-49dc-818c-46b7b4838966 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e3044241-3530-492e-afa1-c8820982a482 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c69c6af-d416-49dc-818c-46b7b4838966 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_40001442-9c32-44e5-86dc-71ec35fd4146@s_e3044241-3530-492e-afa1-c8820982a482', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_e3044241-3530-492e-afa1-c8820982a482', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442551', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112662', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15675310999117116085', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1f46146cac6a3b5c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114287337472', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84962', 'name': 's_e3044241-3530-492e-afa1-c8820982a482', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e3044241-3530-492e-afa1-c8820982a482 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2c69c6af-d416-49dc-818c-46b7b4838966 tempest-VolumesSnapshotListTestJSON-1177713420 None] delete snapshot s_e3044241-3530-492e-afa1-c8820982a482 of volume v_40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c69c6af-d416-49dc-818c-46b7b4838966 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots/s_e3044241-3530-492e-afa1-c8820982a482 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c69c6af-d416-49dc-818c-46b7b4838966 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots/s_e3044241-3530-492e-afa1-c8820982a482 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Geting {'code': 200, 'error': None, 'data': {'available': '114287325184', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:59:12 user cinder-volume[73403]: DEBUG cinder.manager [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:59:12 user cinder-volume[73403]: INFO cinder.volume.manager [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Deleted volume successfully. Apr 14 02:59:12 user cinder-volume[73403]: DEBUG cinder.coordination [None req-9257667a-5b8f-4a56-a9c6-3a02769c387f tempest-VolumesExtendTest-1954853756 None] Lock "cinder-0356ebbf-a388-4461-8bde-93f520cbd314-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:59:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2c69c6af-d416-49dc-818c-46b7b4838966 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots/s_e3044241-3530-492e-afa1-c8820982a482 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2c69c6af-d416-49dc-818c-46b7b4838966 tempest-VolumesSnapshotListTestJSON-1177713420 None] snapshot s_e3044241-3530-492e-afa1-c8820982a482 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:59:13 user cinder-volume[73403]: DEBUG cinder.quota [None req-2c69c6af-d416-49dc-818c-46b7b4838966 tempest-VolumesSnapshotListTestJSON-1177713420 None] Created reservations ['baa60da7-e422-4b35-a9ee-5b81198a49a4', '724ca7a0-1b55-4d88-82dd-e33653bc53ca', 'ea76b764-b865-48a6-ac78-c2bda079bd15', 'db555f7f-de40-48cd-9375-fc79fc48e446'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:59:13 user cinder-volume[73403]: INFO cinder.volume.manager [None req-2c69c6af-d416-49dc-818c-46b7b4838966 tempest-VolumesSnapshotListTestJSON-1177713420 None] Delete snapshot completed successfully. Apr 14 02:59:13 user cinder-volume[73403]: DEBUG cinder.coordination [None req-2c69c6af-d416-49dc-818c-46b7b4838966 tempest-VolumesSnapshotListTestJSON-1177713420 None] Lock "cinder-e3044241-3530-492e-afa1-c8820982a482-delete_snapshot" released by "delete_snapshot" :: held 2.182s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:59:14 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f768d5e3-a7a2-4337-ae2b-20323c861c8c tempest-VolumesSnapshotListTestJSON-1177713420 None] Acquiring lock "cinder-adb8f82e-f028-4bf1-8f22-89448f3c9a90-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:59:14 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f768d5e3-a7a2-4337-ae2b-20323c861c8c tempest-VolumesSnapshotListTestJSON-1177713420 None] Lock "cinder-adb8f82e-f028-4bf1-8f22-89448f3c9a90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:59:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f768d5e3-a7a2-4337-ae2b-20323c861c8c tempest-VolumesSnapshotListTestJSON-1177713420 None] deleating snapshot s_adb8f82e-f028-4bf1-8f22-89448f3c9a90. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 02:59:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f768d5e3-a7a2-4337-ae2b-20323c861c8c tempest-VolumesSnapshotListTestJSON-1177713420 None] get snapshots for volume s_adb8f82e-f028-4bf1-8f22-89448f3c9a90 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:59:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f768d5e3-a7a2-4337-ae2b-20323c861c8c tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_adb8f82e-f028-4bf1-8f22-89448f3c9a90/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f768d5e3-a7a2-4337-ae2b-20323c861c8c tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_adb8f82e-f028-4bf1-8f22-89448f3c9a90/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f768d5e3-a7a2-4337-ae2b-20323c861c8c tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_adb8f82e-f028-4bf1-8f22-89448f3c9a90/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f768d5e3-a7a2-4337-ae2b-20323c861c8c tempest-VolumesSnapshotListTestJSON-1177713420 None] get volume s_adb8f82e-f028-4bf1-8f22-89448f3c9a90 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:59:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f768d5e3-a7a2-4337-ae2b-20323c861c8c tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_adb8f82e-f028-4bf1-8f22-89448f3c9a90 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f768d5e3-a7a2-4337-ae2b-20323c861c8c tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_adb8f82e-f028-4bf1-8f22-89448f3c9a90 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f768d5e3-a7a2-4337-ae2b-20323c861c8c tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_40001442-9c32-44e5-86dc-71ec35fd4146@s_adb8f82e-f028-4bf1-8f22-89448f3c9a90', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_adb8f82e-f028-4bf1-8f22-89448f3c9a90', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442546', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112645', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7863825864292899209', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd9538fc3d4c5da3d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114287362048', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84007', 'name': 's_adb8f82e-f028-4bf1-8f22-89448f3c9a90', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_adb8f82e-f028-4bf1-8f22-89448f3c9a90 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f768d5e3-a7a2-4337-ae2b-20323c861c8c tempest-VolumesSnapshotListTestJSON-1177713420 None] delete snapshot s_adb8f82e-f028-4bf1-8f22-89448f3c9a90 of volume v_40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 02:59:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f768d5e3-a7a2-4337-ae2b-20323c861c8c tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots/s_adb8f82e-f028-4bf1-8f22-89448f3c9a90 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f768d5e3-a7a2-4337-ae2b-20323c861c8c tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots/s_adb8f82e-f028-4bf1-8f22-89448f3c9a90 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f768d5e3-a7a2-4337-ae2b-20323c861c8c tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots/s_adb8f82e-f028-4bf1-8f22-89448f3c9a90 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f768d5e3-a7a2-4337-ae2b-20323c861c8c tempest-VolumesSnapshotListTestJSON-1177713420 None] snapshot s_adb8f82e-f028-4bf1-8f22-89448f3c9a90 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 02:59:16 user cinder-volume[73403]: DEBUG cinder.quota [None req-f768d5e3-a7a2-4337-ae2b-20323c861c8c tempest-VolumesSnapshotListTestJSON-1177713420 None] Created reservations ['4a6a384a-1564-45b1-be31-b24d6c7e5199', '6ff329fe-bfd6-4609-92c1-073b62c10839', '29752e0a-5e6b-4a3c-8097-00873b5f70c2', '429589b1-3f07-4430-a1f7-3e08d3da1edf'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:59:16 user cinder-volume[73403]: INFO cinder.volume.manager [None req-f768d5e3-a7a2-4337-ae2b-20323c861c8c tempest-VolumesSnapshotListTestJSON-1177713420 None] Delete snapshot completed successfully. Apr 14 02:59:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f768d5e3-a7a2-4337-ae2b-20323c861c8c tempest-VolumesSnapshotListTestJSON-1177713420 None] Lock "cinder-adb8f82e-f028-4bf1-8f22-89448f3c9a90-delete_snapshot" released by "delete_snapshot" :: held 2.274s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:59:17 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Acquiring lock "cinder-40001442-9c32-44e5-86dc-71ec35fd4146-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:59:17 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Lock "cinder-40001442-9c32-44e5-86dc-71ec35fd4146-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:59:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] remove_export for volume: 40001442-9c32-44e5-86dc-71ec35fd4146. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 02:59:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 02:59:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-548150738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=40001442-9c32-44e5-86dc-71ec35fd4146,launched_at=2023-04-14T02:58:55Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbe40f2b4274ea58dfc16a77fa670b8',provider_auth='CHAP QxSkreqY Ed5Io6vhkp1NZ3',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:40001442-9c32-44e5-86dc-71ec35fd4146 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:58:54Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T02:59:17Z,updated_at=2023-04-14T02:59:17Z,use_quota=True,user_id='2e7714f95bb44256bd10c8b16b6181ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:40001442-9c32-44e5-86dc-71ec35fd4146. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 02:59:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] detach volume v_40001442-9c32-44e5-86dc-71ec35fd4146 from target iqn.2010-10.org.openstack:40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 02:59:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40001442-9c32-44e5-86dc-71ec35fd4146/luns/v_40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40001442-9c32-44e5-86dc-71ec35fd4146/luns/v_40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:40001442-9c32-44e5-86dc-71ec35fd4146 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40001442-9c32-44e5-86dc-71ec35fd4146/luns/v_40001442-9c32-44e5-86dc-71ec35fd4146'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40001442-9c32-44e5-86dc-71ec35fd4146/luns/v_40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] failed to remove resource iqn.2010-10.org.openstack:40001442-9c32-44e5-86dc-71ec35fd4146 because of JDSS resource v_40001442-9c32-44e5-86dc-71ec35fd4146 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 02:59:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] delete target: iqn.2010-10.org.openstack:40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 02:59:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] delete target iqn.2010-10.org.openstack:40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 02:59:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:40001442-9c32-44e5-86dc-71ec35fd4146 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40001442-9c32-44e5-86dc-71ec35fd4146'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] failed to remove resource iqn.2010-10.org.openstack:40001442-9c32-44e5-86dc-71ec35fd4146 because of JDSS resource iqn.2010-10.org.openstack:40001442-9c32-44e5-86dc-71ec35fd4146 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 02:59:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] deleating volume v_40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 02:59:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] get snapshots for volume v_40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 02:59:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] get volume v_40001442-9c32-44e5-86dc-71ec35fd4146 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:59:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_40001442-9c32-44e5-86dc-71ec35fd4146', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442543', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112635', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12109975357246488923', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd521fa54113c15e8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114287386624', 'san:volume_id': 'd521fa54113c15e8b795826fb1bb8a41a9218b42', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85252', 'name': 'v_40001442-9c32-44e5-86dc-71ec35fd4146', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] delete volume:v_40001442-9c32-44e5-86dc-71ec35fd4146 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 02:59:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_40001442-9c32-44e5-86dc-71ec35fd4146 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] volume v_40001442-9c32-44e5-86dc-71ec35fd4146 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 02:59:19 user cinder-volume[73403]: DEBUG cinder.quota [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Created reservations ['5700cc7e-d042-4e6e-a2fb-e61ccc75c38c', 'abba730c-3094-4f10-bdb3-6eac85f85694', '380efb21-58e1-4801-b819-e7592f008b7b', '34281bb7-4fb4-4989-a67a-7003bbfb8ec8'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 02:59:19 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=51,cinder:INSERT=10,cinder:UPDATE=39 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 02:59:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 02:59:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Geting {'code': 200, 'error': None, 'data': {'available': '114287480832', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 02:59:20 user cinder-volume[73403]: DEBUG cinder.manager [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:59:20 user cinder-volume[73403]: INFO cinder.volume.manager [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Deleted volume successfully. Apr 14 02:59:20 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7e0db6a0-f080-4021-b3a7-7aa1c5d88021 tempest-VolumesSnapshotListTestJSON-1177713420 None] Lock "cinder-40001442-9c32-44e5-86dc-71ec35fd4146-delete_volume" released by "delete_volume" :: held 3.265s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:59:21 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:59:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Flow 'volume_create_manager' (dd483456-d49e-4e6b-8a20-e0fa939d2b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:59:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ed3924-a97e-4a62-8d33-79548bc979bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ed3924-a97e-4a62-8d33-79548bc979bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1947376354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=edd92bd4-26a2-4652-bdc6-77805711142a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6371b4c05df843da9b134e12994c1d7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:59:21Z,use_quota=True,user_id='337e2d8118324215b5a0baa36a5895b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f388a16b-b036-42a0-99ea-3288f768ba7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f388a16b-b036-42a0-99ea-3288f768ba7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (390637ab-6880-4009-9f8c-c1b21cd10ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (390637ab-6880-4009-9f8c-c1b21cd10ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edd92bd4-26a2-4652-bdc6-77805711142a', 'volume_name': 'volume-edd92bd4-26a2-4652-bdc6-77805711142a', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08cdcaf1-0e8c-4aa6-8371-4896bcff6851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08cdcaf1-0e8c-4aa6-8371-4896bcff6851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ccf344-ad1c-4cc3-9db6-f7998c31d058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:21 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Volume edd92bd4-26a2-4652-bdc6-77805711142a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edd92bd4-26a2-4652-bdc6-77805711142a', 'volume_size': 1} Apr 14 02:59:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] creating volume v_edd92bd4-26a2-4652-bdc6-77805711142a. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:59:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] create volume {'name': 'v_edd92bd4-26a2-4652-bdc6-77805711142a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:59:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_edd92bd4-26a2-4652-bdc6-77805711142a', 'is_clone': False, 'name': 'v_edd92bd4-26a2-4652-bdc6-77805711142a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ccf344-ad1c-4cc3-9db6-f7998c31d058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edd92bd4-26a2-4652-bdc6-77805711142a', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d23bad97-c1e9-4de7-8c3e-b98d1590feb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:22 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Volume volume-edd92bd4-26a2-4652-bdc6-77805711142a (edd92bd4-26a2-4652-bdc6-77805711142a): created successfully Apr 14 02:59:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d23bad97-c1e9-4de7-8c3e-b98d1590feb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Flow 'volume_create_manager' (dd483456-d49e-4e6b-8a20-e0fa939d2b85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:59:22 user cinder-volume[73403]: INFO cinder.volume.manager [None req-0a85ad61-7d59-4c5c-8c4a-cc9a67165b29 tempest-TestStampPattern-323884970 None] Created volume successfully. Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Flow 'volume_create_manager' (10cdf426-9c9b-4c0f-9cb4-7e3ead04d4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132b3686-f3b7-4a1d-aa84-898e558d2231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132b3686-f3b7-4a1d-aa84-898e558d2231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-330078690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c32c5b58-bb91-48df-a4b1-97d399d833ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2e49e8e92e416faebf55e3d4e0e087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:59:29Z,use_quota=True,user_id='60e11b7ab2914209b23bf7a53791da64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c633baa-9032-4cd6-9451-cc8c8c1c6ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c633baa-9032-4cd6-9451-cc8c8c1c6ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1d4f58-1e92-4dd9-a0b9-abd0e8129886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1d4f58-1e92-4dd9-a0b9-abd0e8129886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c32c5b58-bb91-48df-a4b1-97d399d833ff', 'volume_name': 'volume-c32c5b58-bb91-48df-a4b1-97d399d833ff', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb5a522-d74a-4e3e-a694-4e433a365bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb5a522-d74a-4e3e-a694-4e433a365bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fac32a7c-1195-40d8-b660-22685c9fb979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:29 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Volume c32c5b58-bb91-48df-a4b1-97d399d833ff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c32c5b58-bb91-48df-a4b1-97d399d833ff', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Cloning c32c5b58-bb91-48df-a4b1-97d399d833ff from image 98e6a247-250b-4bb5-a947-e7f93598d16e at location (None, None). {{(pid=73403) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Acquiring lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" by "_prepare_image_cache_entry" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 2, 59, 29, 531155)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Found cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Attempting to retrieve cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 2, 59, 29, 547473)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Creating from source image-volume 482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] cloned volume 482f938f-083c-4221-99f8-3320a80b8725 to c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] cloning v_482f938f-083c-4221-99f8-3320a80b8725 to v_c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] create snapshot v_c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_c32c5b58-bb91-48df-a4b1-97d399d833ff'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] create volume v_c32c5b58-bb91-48df-a4b1-97d399d833ff from snapshot v_c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:59:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_c32c5b58-bb91-48df-a4b1-97d399d833ff', 'is_clone': True, 'full_name': 'Pool-0/v_c32c5b58-bb91-48df-a4b1-97d399d833ff', 'name': 'v_c32c5b58-bb91-48df-a4b1-97d399d833ff'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] get volume v_c32c5b58-bb91-48df-a4b1-97d399d833ff info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:59:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_c32c5b58-bb91-48df-a4b1-97d399d833ff', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c32c5b58-bb91-48df-a4b1-97d399d833ff', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442580', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '112703', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '558993242203041143', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a73861f8d68beaab', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114287398912', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85516', 'name': 'v_c32c5b58-bb91-48df-a4b1-97d399d833ff', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:31 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Marking volume c32c5b58-bb91-48df-a4b1-97d399d833ff as bootable. {{(pid=73403) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 02:59:31 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Copying metadata from image 98e6a247-250b-4bb5-a947-e7f93598d16e to c32c5b58-bb91-48df-a4b1-97d399d833ff. {{(pid=73403) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 02:59:31 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Creating volume glance metadata for volume c32c5b58-bb91-48df-a4b1-97d399d833ff backed by image 98e6a247-250b-4bb5-a947-e7f93598d16e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73403) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 02:59:31 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:INSERT=11,cinder:SELECT=57,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fac32a7c-1195-40d8-b660-22685c9fb979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c32c5b58-bb91-48df-a4b1-97d399d833ff', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0434aedc-d10a-45a6-9ce3-6358f43afbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:31 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Volume volume-c32c5b58-bb91-48df-a4b1-97d399d833ff (c32c5b58-bb91-48df-a4b1-97d399d833ff): created successfully Apr 14 02:59:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0434aedc-d10a-45a6-9ce3-6358f43afbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Flow 'volume_create_manager' (10cdf426-9c9b-4c0f-9cb4-7e3ead04d4a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:59:31 user cinder-volume[73403]: INFO cinder.volume.manager [None req-ca1f8485-f226-4e96-a08e-c1ec2f3c41bd tempest-TestVolumeBootPattern-910285030 None] Created volume successfully. Apr 14 02:59:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0579a2da-ba58-4699-82db-f78166b1b5b6 tempest-TestVolumeBootPattern-910285030 None] create snapshot ce95f5fe-2669-423c-8ac4-9edd6f1c5f54 for volume c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 02:59:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0579a2da-ba58-4699-82db-f78166b1b5b6 tempest-TestVolumeBootPattern-910285030 None] cloning v_c32c5b58-bb91-48df-a4b1-97d399d833ff to s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:59:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0579a2da-ba58-4699-82db-f78166b1b5b6 tempest-TestVolumeBootPattern-910285030 None] create snapshot s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:59:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0579a2da-ba58-4699-82db-f78166b1b5b6 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c32c5b58-bb91-48df-a4b1-97d399d833ff/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0579a2da-ba58-4699-82db-f78166b1b5b6 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c32c5b58-bb91-48df-a4b1-97d399d833ff/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0579a2da-ba58-4699-82db-f78166b1b5b6 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c32c5b58-bb91-48df-a4b1-97d399d833ff/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0579a2da-ba58-4699-82db-f78166b1b5b6 tempest-TestVolumeBootPattern-910285030 None] create volume s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54 from snapshot s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:59:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0579a2da-ba58-4699-82db-f78166b1b5b6 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c32c5b58-bb91-48df-a4b1-97d399d833ff/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0579a2da-ba58-4699-82db-f78166b1b5b6 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c32c5b58-bb91-48df-a4b1-97d399d833ff/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0579a2da-ba58-4699-82db-f78166b1b5b6 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c32c5b58-bb91-48df-a4b1-97d399d833ff@s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54', 'is_clone': True, 'full_name': 'Pool-0/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54', 'name': 's_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c32c5b58-bb91-48df-a4b1-97d399d833ff/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0579a2da-ba58-4699-82db-f78166b1b5b6 tempest-TestVolumeBootPattern-910285030 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0579a2da-ba58-4699-82db-f78166b1b5b6 tempest-TestVolumeBootPattern-910285030 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0579a2da-ba58-4699-82db-f78166b1b5b6 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0579a2da-ba58-4699-82db-f78166b1b5b6 tempest-TestVolumeBootPattern-910285030 None] volume s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 02:59:35 user cinder-volume[73403]: INFO cinder.volume.manager [None req-0579a2da-ba58-4699-82db-f78166b1b5b6 tempest-TestVolumeBootPattern-910285030 None] Create snapshot completed successfully Apr 14 02:59:38 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:59:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Flow 'volume_create_manager' (53d96cd1-51f2-4a07-8b70-a421095c89a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:59:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c2183d-dbff-4220-8afe-896e9d5bac0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c2183d-dbff-4220-8afe-896e9d5bac0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:59:38Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=47e890f1-6257-486b-ab68-7d91ac9f65bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2e49e8e92e416faebf55e3d4e0e087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ce95f5fe-2669-423c-8ac4-9edd6f1c5f54,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:59:38Z,use_quota=True,user_id='60e11b7ab2914209b23bf7a53791da64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2422dd3-6d0b-4aa9-aeb5-b8b751e701bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2422dd3-6d0b-4aa9-aeb5-b8b751e701bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe2b65d-0a78-4c19-971b-81e096a3c2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe2b65d-0a78-4c19-971b-81e096a3c2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '47e890f1-6257-486b-ab68-7d91ac9f65bf', 'volume_name': 'volume-47e890f1-6257-486b-ab68-7d91ac9f65bf', 'volume_size': 1, 'snapshot_id': 'ce95f5fe-2669-423c-8ac4-9edd6f1c5f54'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abf00ad-eef7-439c-8c4a-5fa41f4362d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abf00ad-eef7-439c-8c4a-5fa41f4362d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc4fc0f-652c-4813-a787-1fd1fc5ccabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:38 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Volume 47e890f1-6257-486b-ab68-7d91ac9f65bf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-47e890f1-6257-486b-ab68-7d91ac9f65bf', 'volume_size': 1, 'snapshot_id': 'ce95f5fe-2669-423c-8ac4-9edd6f1c5f54'} Apr 14 02:59:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] create volume 47e890f1-6257-486b-ab68-7d91ac9f65bf from snapshot ce95f5fe-2669-423c-8ac4-9edd6f1c5f54 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 02:59:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] cloning s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54 to v_47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 02:59:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] create snapshot v_47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 02:59:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_47e890f1-6257-486b-ab68-7d91ac9f65bf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] create volume v_47e890f1-6257-486b-ab68-7d91ac9f65bf from snapshot v_47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 02:59:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54@v_47e890f1-6257-486b-ab68-7d91ac9f65bf', 'is_clone': True, 'full_name': 'Pool-0/v_47e890f1-6257-486b-ab68-7d91ac9f65bf', 'name': 'v_47e890f1-6257-486b-ab68-7d91ac9f65bf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] get volume v_47e890f1-6257-486b-ab68-7d91ac9f65bf info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 02:59:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54@v_47e890f1-6257-486b-ab68-7d91ac9f65bf', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_47e890f1-6257-486b-ab68-7d91ac9f65bf', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442588', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '112715', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12397934117239551544', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8a293c3d4c1dbbfe', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114287398912', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85547', 'name': 'v_47e890f1-6257-486b-ab68-7d91ac9f65bf', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:40 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Marking volume 47e890f1-6257-486b-ab68-7d91ac9f65bf as bootable. {{(pid=73403) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 02:59:40 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Copying metadata from snapshot ce95f5fe-2669-423c-8ac4-9edd6f1c5f54 to 47e890f1-6257-486b-ab68-7d91ac9f65bf. {{(pid=73403) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Apr 14 02:59:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc4fc0f-652c-4813-a787-1fd1fc5ccabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47e890f1-6257-486b-ab68-7d91ac9f65bf', 'volume_size': 1, 'snapshot_id': 'ce95f5fe-2669-423c-8ac4-9edd6f1c5f54'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8011f194-ac71-48d5-890e-7075d72fb62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:40 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Volume volume-47e890f1-6257-486b-ab68-7d91ac9f65bf (47e890f1-6257-486b-ab68-7d91ac9f65bf): created successfully Apr 14 02:59:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8011f194-ac71-48d5-890e-7075d72fb62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Flow 'volume_create_manager' (53d96cd1-51f2-4a07-8b70-a421095c89a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:59:40 user cinder-volume[73403]: INFO cinder.volume.manager [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-d7c0ab04-1247-4b45-8449-ed6e889854e4 tempest-TestVolumeBootPattern-910285030 None] Created volume successfully. Apr 14 02:59:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] create export for volume: 47e890f1-6257-486b-ab68-7d91ac9f65bf. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 02:59:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] ensure volume 47e890f1-6257-486b-ab68-7d91ac9f65bf assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 02:59:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] check if targe iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 02:59:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] create target and attach volume 47e890f1-6257-486b-ab68-7d91ac9f65bf to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 02:59:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] create target iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 02:59:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:47 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:59:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Flow 'volume_create_manager' (e8b3e836-01e6-42f3-9e18-7bbdaf27f738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:59:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ecc05c-bfd5-4c81-8020-3481289623b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ecc05c-bfd5-4c81-8020-3481289623b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-197093691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d1ac2d2b-c18f-4958-a86e-fa298a15c9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130665008cf648cf87467ae2777a9170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:59:47Z,use_quota=True,user_id='d6d78d4991b5493e8893034e91ed407b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76299a8-aa07-4957-aa0e-0dac965b3782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76299a8-aa07-4957-aa0e-0dac965b3782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1744fd5-b71c-40e1-94f3-48292bc78d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1744fd5-b71c-40e1-94f3-48292bc78d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1ac2d2b-c18f-4958-a86e-fa298a15c9b8', 'volume_name': 'volume-d1ac2d2b-c18f-4958-a86e-fa298a15c9b8', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (993f47ee-fed2-4a01-a057-5eead1a6a9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (993f47ee-fed2-4a01-a057-5eead1a6a9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c56c8cd-84f7-480b-a832-373e855826c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:47 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Volume d1ac2d2b-c18f-4958-a86e-fa298a15c9b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1ac2d2b-c18f-4958-a86e-fa298a15c9b8', 'volume_size': 1} Apr 14 02:59:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] creating volume v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:59:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] create volume {'name': 'v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:59:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] atach volume v_47e890f1-6257-486b-ab68-7d91ac9f65bf to target iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 02:59:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8', 'is_clone': False, 'name': 'v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c56c8cd-84f7-480b-a832-373e855826c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1ac2d2b-c18f-4958-a86e-fa298a15c9b8', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128a91ef-4df9-4215-8590-bfaa73e4efdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:48 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Volume volume-d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 (d1ac2d2b-c18f-4958-a86e-fa298a15c9b8): created successfully Apr 14 02:59:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128a91ef-4df9-4215-8590-bfaa73e4efdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Flow 'volume_create_manager' (e8b3e836-01e6-42f3-9e18-7bbdaf27f738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:59:48 user cinder-volume[73403]: INFO cinder.volume.manager [None req-224f1b7a-8aab-4018-9ea5-7d89d5cc7d73 tempest-AttachVolumeTestJSON-975876676 None] Created volume successfully. Apr 14 02:59:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3861323933633364', 'lun': 0, 'mode': 'wt', 'name': 'v_47e890f1-6257-486b-ab68-7d91ac9f65bf', 'prod_id': 'Storage', 'scsi_id': '8a293c3d4c1dbbfe'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] add credentails to target iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 02:59:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': {'name': 'JcvzNKnb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] initialize_connection for 47e890f1-6257-486b-ab68-7d91ac9f65bf 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 02:59:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcvzNKnb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '9a5f6596-6d83-438b-bfae-fe7d1c5b35bf'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 02:59:49 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=58,cinder:DELETE=4,cinder:UPDATE=16,cinder:INSERT=22 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:59:49 user cinder-volume[73403]: INFO cinder.volume.manager [req-99f03fd2-5b9b-4316-9e40-7059ed19e510 req-90a5addb-b817-4e46-8d60-19a8004dce94 tempest-TestVolumeBootPattern-910285030 None] attachment_update completed successfully. Apr 14 02:59:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] create export for volume: d1ac2d2b-c18f-4958-a86e-fa298a15c9b8. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 02:59:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] ensure volume d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 02:59:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] check if targe iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 02:59:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] create target and attach volume d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 02:59:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] create target iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 02:59:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] atach volume v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 to target iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 02:59:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3531323766386562', 'lun': 0, 'mode': 'wt', 'name': 'v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8', 'prod_id': 'Storage', 'scsi_id': '5127f8eb1709433a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] add credentails to target iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 201, 'error': None, 'data': {'name': 'mpkibDRE'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] initialize_connection for d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpkibDRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '74d9f89b-3416-45c5-8af8-870134e07548'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 02:59:55 user cinder-volume[73403]: INFO cinder.volume.manager [req-9e23dcc2-0c6c-401f-b8e5-3301583b9b7c req-6c83f8fe-00a4-4245-b593-16ec84c771a0 tempest-AttachVolumeTestJSON-975876676 None] attachment_update completed successfully. Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Flow 'volume_create_manager' (00e956a2-0100-477c-9609-827fa3c308d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e4551a-c912-4e2d-92ac-0defd7e53d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e4551a-c912-4e2d-92ac-0defd7e53d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1865978163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d9358de3-07e9-437f-983f-50a585699a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cec85cd4364c8eaad6870b92249a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T02:59:55Z,use_quota=True,user_id='70eb1e59ba1342688a8ce4e6ff440f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf61c52-1bde-489e-a18c-c71f133766ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf61c52-1bde-489e-a18c-c71f133766ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f03a45-8842-4f14-8ad2-a78472db15a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f03a45-8842-4f14-8ad2-a78472db15a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9358de3-07e9-437f-983f-50a585699a89', 'volume_name': 'volume-d9358de3-07e9-437f-983f-50a585699a89', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2bc47b-2f92-49bc-a268-6de0149779ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2bc47b-2f92-49bc-a268-6de0149779ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66faa77-6273-4ed5-a7a3-d2c0545f802f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:55 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Volume d9358de3-07e9-437f-983f-50a585699a89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9358de3-07e9-437f-983f-50a585699a89', 'volume_size': 1} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] creating volume v_d9358de3-07e9-437f-983f-50a585699a89. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] create volume {'name': 'v_d9358de3-07e9-437f-983f-50a585699a89', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d9358de3-07e9-437f-983f-50a585699a89', 'is_clone': False, 'name': 'v_d9358de3-07e9-437f-983f-50a585699a89'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66faa77-6273-4ed5-a7a3-d2c0545f802f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9358de3-07e9-437f-983f-50a585699a89', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1fbc019-1a88-454d-9d7e-057b01ce031d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 02:59:56 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Volume volume-d9358de3-07e9-437f-983f-50a585699a89 (d9358de3-07e9-437f-983f-50a585699a89): created successfully Apr 14 02:59:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1fbc019-1a88-454d-9d7e-057b01ce031d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 02:59:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Flow 'volume_create_manager' (00e956a2-0100-477c-9609-827fa3c308d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 02:59:56 user cinder-volume[73403]: INFO cinder.volume.manager [None req-e375663c-2aaa-4030-8087-a308355e3bad tempest-DeleteServersTestJSON-360109579 None] Created volume successfully. Apr 14 02:59:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] create export for volume: d9358de3-07e9-437f-983f-50a585699a89. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 02:59:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] ensure volume d9358de3-07e9-437f-983f-50a585699a89 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 02:59:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] check if targe iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 02:59:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 02:59:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 02:59:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] create target and attach volume d9358de3-07e9-437f-983f-50a585699a89 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 02:59:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] create target iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 02:59:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 02:59:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] atach volume v_d9358de3-07e9-437f-983f-50a585699a89 to target iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:00:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:02 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=13,cinder:SELECT=59,cinder:DELETE=1,cinder:INSERT=13 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:00:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3834326637306364', 'lun': 0, 'mode': 'wt', 'name': 'v_d9358de3-07e9-437f-983f-50a585699a89', 'prod_id': 'Storage', 'scsi_id': '842f70cd9f433895'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] add credentails to target iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:00:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] Geting {'code': 201, 'error': None, 'data': {'name': 'noqgYikX'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] initialize_connection for d9358de3-07e9-437f-983f-50a585699a89 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:00:02 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'noqgYikX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'ce6ca826-b762-4f71-9690-52f856d57d91'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:00:02 user cinder-volume[73403]: INFO cinder.volume.manager [req-982938a8-b635-4c33-bd57-6c2111a7dbb9 req-df0e9a82-e8b1-4429-9893-aea1ef22d206 tempest-DeleteServersTestJSON-360109579 None] attachment_update completed successfully. Apr 14 03:00:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:00:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:00:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:00:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114287173632', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:00:03 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f req-63474454-86fc-4681-8b19-f84bde00cfbc tempest-DeleteServersTestJSON-360109579 None] terminate connection for d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:00:08 user cinder-volume[73403]: INFO cinder.volume.manager [req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f req-63474454-86fc-4681-8b19-f84bde00cfbc tempest-DeleteServersTestJSON-360109579 None] Terminate volume connection completed successfully. Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f req-63474454-86fc-4681-8b19-f84bde00cfbc tempest-DeleteServersTestJSON-360109579 None] Deleting attachment ce6ca826-b762-4f71-9690-52f856d57d91. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f req-63474454-86fc-4681-8b19-f84bde00cfbc tempest-DeleteServersTestJSON-360109579 None] remove_export for volume: d9358de3-07e9-437f-983f-50a585699a89. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f req-63474454-86fc-4681-8b19-f84bde00cfbc tempest-DeleteServersTestJSON-360109579 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f req-63474454-86fc-4681-8b19-f84bde00cfbc tempest-DeleteServersTestJSON-360109579 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1865978163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d9358de3-07e9-437f-983f-50a585699a89,launched_at=2023-04-14T02:59:57Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='46cec85cd4364c8eaad6870b92249a56',provider_auth='CHAP noqgYikX CDaikjQbRurT4p',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:59:55Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:00:05Z,use_quota=True,user_id='70eb1e59ba1342688a8ce4e6ff440f58',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f req-63474454-86fc-4681-8b19-f84bde00cfbc tempest-DeleteServersTestJSON-360109579 None] detach volume v_d9358de3-07e9-437f-983f-50a585699a89 from target iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f req-63474454-86fc-4681-8b19-f84bde00cfbc tempest-DeleteServersTestJSON-360109579 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89/luns/v_d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f req-63474454-86fc-4681-8b19-f84bde00cfbc tempest-DeleteServersTestJSON-360109579 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89/luns/v_d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Flow 'volume_create_manager' (e6934f07-2d8f-4e07-91d3-5e6043a1e832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc9195e-4ec2-424f-905e-b6c4539d9d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc9195e-4ec2-424f-905e-b6c4539d9d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2044133642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c85af65b-ba3d-4e6f-9d4b-0da7c73c091b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94a1eb61159b43228db0d529a5be816d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:00:09Z,use_quota=True,user_id='f0d4916eb93c4b3ebbbd2af4b0cdacc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (312ab6c8-bb92-46b6-9ebb-62ad6c181daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (312ab6c8-bb92-46b6-9ebb-62ad6c181daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b6e1ed-3587-4d12-ae63-06360694f68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b6e1ed-3587-4d12-ae63-06360694f68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c85af65b-ba3d-4e6f-9d4b-0da7c73c091b', 'volume_name': 'volume-c85af65b-ba3d-4e6f-9d4b-0da7c73c091b', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b65e4cf-4c58-455b-a858-a505030e57a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b65e4cf-4c58-455b-a858-a505030e57a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb35cf6c-1356-4f67-b919-604173cfee2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:00:08 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Volume c85af65b-ba3d-4e6f-9d4b-0da7c73c091b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c85af65b-ba3d-4e6f-9d4b-0da7c73c091b', 'volume_size': 1} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] creating volume v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] create volume {'name': 'v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f req-63474454-86fc-4681-8b19-f84bde00cfbc tempest-DeleteServersTestJSON-360109579 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89/luns/v_d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f req-63474454-86fc-4681-8b19-f84bde00cfbc tempest-DeleteServersTestJSON-360109579 None] delete target: iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:00:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f req-63474454-86fc-4681-8b19-f84bde00cfbc tempest-DeleteServersTestJSON-360109579 None] delete target iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:00:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f req-63474454-86fc-4681-8b19-f84bde00cfbc tempest-DeleteServersTestJSON-360109579 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f req-63474454-86fc-4681-8b19-f84bde00cfbc tempest-DeleteServersTestJSON-360109579 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f req-63474454-86fc-4681-8b19-f84bde00cfbc tempest-DeleteServersTestJSON-360109579 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-925d4cca-a93c-4e3c-ab52-b34df0fbfd7f req-63474454-86fc-4681-8b19-f84bde00cfbc tempest-DeleteServersTestJSON-360109579 None] target iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:00:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b', 'is_clone': False, 'name': 'v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb35cf6c-1356-4f67-b919-604173cfee2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c85af65b-ba3d-4e6f-9d4b-0da7c73c091b', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:00:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33081e60-e3ae-4851-b83d-993651b9ebb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:00:10 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Volume volume-c85af65b-ba3d-4e6f-9d4b-0da7c73c091b (c85af65b-ba3d-4e6f-9d4b-0da7c73c091b): created successfully Apr 14 03:00:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33081e60-e3ae-4851-b83d-993651b9ebb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:00:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Flow 'volume_create_manager' (e6934f07-2d8f-4e07-91d3-5e6043a1e832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:00:10 user cinder-volume[73403]: INFO cinder.volume.manager [None req-9a1a3fdf-d343-443b-a5bd-c28e7f242ff4 tempest-VolumesAdminNegativeTest-1232189050 None] Created volume successfully. Apr 14 03:00:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] create export for volume: c85af65b-ba3d-4e6f-9d4b-0da7c73c091b. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:00:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] ensure volume c85af65b-ba3d-4e6f-9d4b-0da7c73c091b assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:00:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] check if targe iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:00:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] create target and attach volume c85af65b-ba3d-4e6f-9d4b-0da7c73c091b to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:00:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] create target iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:00:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] atach volume v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b to target iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:00:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6265623730383336', 'lun': 0, 'mode': 'wt', 'name': 'v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b', 'prod_id': 'Storage', 'scsi_id': 'beb70836820f097f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] add credentails to target iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:00:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] Geting {'code': 201, 'error': None, 'data': {'name': 'kXUbzEVK'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] initialize_connection for c85af65b-ba3d-4e6f-9d4b-0da7c73c091b 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:00:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kXUbzEVK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '1112ebb6-7d87-4efa-97ba-37d8b23357cd'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:00:15 user cinder-volume[73403]: INFO cinder.volume.manager [req-f460826f-ae62-441b-befc-f957a88addab req-c5521511-029c-49c0-b9ed-5b2acb178d50 tempest-VolumesAdminNegativeTest-1232189050 None] attachment_update completed successfully. Apr 14 03:00:17 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:00:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Flow 'volume_create_manager' (ae0973a1-40a8-46e2-acad-75bca02a9e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:00:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994cc20b-4a13-4583-b6d2-4705ef75a8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:00:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994cc20b-4a13-4583-b6d2-4705ef75a8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-816542445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e898aaea-41c4-4fc9-ac07-5d27f62094c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcbeb4e2fdc1420c98c264aac62340a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:00:18Z,use_quota=True,user_id='9eabf8254cde4d86a1862934ec9b5240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:00:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2da1871-20f7-41e5-bc6f-14b1e6696a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:00:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2da1871-20f7-41e5-bc6f-14b1e6696a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:00:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ca54b5-752a-4519-bfb4-84245fb53329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:00:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ca54b5-752a-4519-bfb4-84245fb53329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e898aaea-41c4-4fc9-ac07-5d27f62094c4', 'volume_name': 'volume-e898aaea-41c4-4fc9-ac07-5d27f62094c4', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:00:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b3b7a9-6a7d-415f-99c3-2cea42c202c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:00:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b3b7a9-6a7d-415f-99c3-2cea42c202c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:00:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2fc7fa4-849b-422a-ae66-eba262e8eef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:00:17 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Volume e898aaea-41c4-4fc9-ac07-5d27f62094c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e898aaea-41c4-4fc9-ac07-5d27f62094c4', 'volume_size': 1} Apr 14 03:00:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] creating volume v_e898aaea-41c4-4fc9-ac07-5d27f62094c4. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:00:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] create volume {'name': 'v_e898aaea-41c4-4fc9-ac07-5d27f62094c4', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:00:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e898aaea-41c4-4fc9-ac07-5d27f62094c4', 'is_clone': False, 'name': 'v_e898aaea-41c4-4fc9-ac07-5d27f62094c4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2fc7fa4-849b-422a-ae66-eba262e8eef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e898aaea-41c4-4fc9-ac07-5d27f62094c4', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:00:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3217c402-584e-4da9-86be-f8ee575a86d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:00:18 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Volume volume-e898aaea-41c4-4fc9-ac07-5d27f62094c4 (e898aaea-41c4-4fc9-ac07-5d27f62094c4): created successfully Apr 14 03:00:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3217c402-584e-4da9-86be-f8ee575a86d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:00:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Flow 'volume_create_manager' (ae0973a1-40a8-46e2-acad-75bca02a9e1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:00:18 user cinder-volume[73403]: INFO cinder.volume.manager [None req-e7e4b627-562a-480f-a206-5916f265cc53 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Created volume successfully. Apr 14 03:00:20 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=55,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d14f329d-5bc4-4988-9337-40e04e52fb4d req-50da196f-c7bd-47e1-a80d-f320f07e1699 tempest-VolumesAdminNegativeTest-1232189050 None] terminate connection for c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:00:20 user cinder-volume[73403]: INFO cinder.volume.manager [req-d14f329d-5bc4-4988-9337-40e04e52fb4d req-50da196f-c7bd-47e1-a80d-f320f07e1699 tempest-VolumesAdminNegativeTest-1232189050 None] Terminate volume connection completed successfully. Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-d14f329d-5bc4-4988-9337-40e04e52fb4d req-50da196f-c7bd-47e1-a80d-f320f07e1699 tempest-VolumesAdminNegativeTest-1232189050 None] Deleting attachment 1112ebb6-7d87-4efa-97ba-37d8b23357cd. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d14f329d-5bc4-4988-9337-40e04e52fb4d req-50da196f-c7bd-47e1-a80d-f320f07e1699 tempest-VolumesAdminNegativeTest-1232189050 None] remove_export for volume: c85af65b-ba3d-4e6f-9d4b-0da7c73c091b. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d14f329d-5bc4-4988-9337-40e04e52fb4d req-50da196f-c7bd-47e1-a80d-f320f07e1699 tempest-VolumesAdminNegativeTest-1232189050 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d14f329d-5bc4-4988-9337-40e04e52fb4d req-50da196f-c7bd-47e1-a80d-f320f07e1699 tempest-VolumesAdminNegativeTest-1232189050 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2044133642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c85af65b-ba3d-4e6f-9d4b-0da7c73c091b,launched_at=2023-04-14T03:00:10Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='94a1eb61159b43228db0d529a5be816d',provider_auth='CHAP kXUbzEVK KDoNCAxt0PXGs8',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:00:09Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:00:19Z,use_quota=True,user_id='f0d4916eb93c4b3ebbbd2af4b0cdacc1',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d14f329d-5bc4-4988-9337-40e04e52fb4d req-50da196f-c7bd-47e1-a80d-f320f07e1699 tempest-VolumesAdminNegativeTest-1232189050 None] detach volume v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b from target iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d14f329d-5bc4-4988-9337-40e04e52fb4d req-50da196f-c7bd-47e1-a80d-f320f07e1699 tempest-VolumesAdminNegativeTest-1232189050 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b/luns/v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d14f329d-5bc4-4988-9337-40e04e52fb4d req-50da196f-c7bd-47e1-a80d-f320f07e1699 tempest-VolumesAdminNegativeTest-1232189050 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b/luns/v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] create export for volume: e898aaea-41c4-4fc9-ac07-5d27f62094c4. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] ensure volume e898aaea-41c4-4fc9-ac07-5d27f62094c4 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] check if targe iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] create target and attach volume e898aaea-41c4-4fc9-ac07-5d27f62094c4 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] create target iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d14f329d-5bc4-4988-9337-40e04e52fb4d req-50da196f-c7bd-47e1-a80d-f320f07e1699 tempest-VolumesAdminNegativeTest-1232189050 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b/luns/v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d14f329d-5bc4-4988-9337-40e04e52fb4d req-50da196f-c7bd-47e1-a80d-f320f07e1699 tempest-VolumesAdminNegativeTest-1232189050 None] delete target: iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d14f329d-5bc4-4988-9337-40e04e52fb4d req-50da196f-c7bd-47e1-a80d-f320f07e1699 tempest-VolumesAdminNegativeTest-1232189050 None] delete target iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d14f329d-5bc4-4988-9337-40e04e52fb4d req-50da196f-c7bd-47e1-a80d-f320f07e1699 tempest-VolumesAdminNegativeTest-1232189050 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d14f329d-5bc4-4988-9337-40e04e52fb4d req-50da196f-c7bd-47e1-a80d-f320f07e1699 tempest-VolumesAdminNegativeTest-1232189050 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d14f329d-5bc4-4988-9337-40e04e52fb4d req-50da196f-c7bd-47e1-a80d-f320f07e1699 tempest-VolumesAdminNegativeTest-1232189050 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d14f329d-5bc4-4988-9337-40e04e52fb4d req-50da196f-c7bd-47e1-a80d-f320f07e1699 tempest-VolumesAdminNegativeTest-1232189050 None] target iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:00:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] atach volume v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 to target iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:00:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6133393363393966', 'lun': 0, 'mode': 'wt', 'name': 'v_e898aaea-41c4-4fc9-ac07-5d27f62094c4', 'prod_id': 'Storage', 'scsi_id': 'a393c99fcbc4529b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] add credentails to target iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:00:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Geting {'code': 201, 'error': None, 'data': {'name': 'vmqUDaix'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] initialize_connection for e898aaea-41c4-4fc9-ac07-5d27f62094c4 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:00:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmqUDaix', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '53380ad5-ca10-49bc-9601-140192017fdf'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:00:24 user cinder-volume[73403]: INFO cinder.volume.manager [req-375094ad-6d2b-4cc0-8bbc-06d31f110bc0 req-a85de0c5-e929-4ec8-b7fe-e7faf3c13615 tempest-AttachSCSIVolumeTestJSON-1798094222 None] attachment_update completed successfully. Apr 14 03:00:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a6fe4b60-0ecd-4422-9ede-418ee997e31c req-9611a268-ad01-49a4-a560-e68782ce212c tempest-AttachSCSIVolumeTestJSON-1798094222 None] terminate connection for e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:00:27 user cinder-volume[73403]: INFO cinder.volume.manager [req-a6fe4b60-0ecd-4422-9ede-418ee997e31c req-9611a268-ad01-49a4-a560-e68782ce212c tempest-AttachSCSIVolumeTestJSON-1798094222 None] Terminate volume connection completed successfully. Apr 14 03:00:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-a6fe4b60-0ecd-4422-9ede-418ee997e31c req-9611a268-ad01-49a4-a560-e68782ce212c tempest-AttachSCSIVolumeTestJSON-1798094222 None] Deleting attachment 53380ad5-ca10-49bc-9601-140192017fdf. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:00:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a6fe4b60-0ecd-4422-9ede-418ee997e31c req-9611a268-ad01-49a4-a560-e68782ce212c tempest-AttachSCSIVolumeTestJSON-1798094222 None] remove_export for volume: e898aaea-41c4-4fc9-ac07-5d27f62094c4. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:00:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a6fe4b60-0ecd-4422-9ede-418ee997e31c req-9611a268-ad01-49a4-a560-e68782ce212c tempest-AttachSCSIVolumeTestJSON-1798094222 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:00:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a6fe4b60-0ecd-4422-9ede-418ee997e31c req-9611a268-ad01-49a4-a560-e68782ce212c tempest-AttachSCSIVolumeTestJSON-1798094222 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-816542445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e898aaea-41c4-4fc9-ac07-5d27f62094c4,launched_at=2023-04-14T03:00:19Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='bcbeb4e2fdc1420c98c264aac62340a7',provider_auth='CHAP vmqUDaix kISTOEx14nLQ96',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:00:18Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:00:27Z,use_quota=True,user_id='9eabf8254cde4d86a1862934ec9b5240',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:00:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a6fe4b60-0ecd-4422-9ede-418ee997e31c req-9611a268-ad01-49a4-a560-e68782ce212c tempest-AttachSCSIVolumeTestJSON-1798094222 None] detach volume v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 from target iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:00:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a6fe4b60-0ecd-4422-9ede-418ee997e31c req-9611a268-ad01-49a4-a560-e68782ce212c tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4/luns/v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a6fe4b60-0ecd-4422-9ede-418ee997e31c req-9611a268-ad01-49a4-a560-e68782ce212c tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4/luns/v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a6fe4b60-0ecd-4422-9ede-418ee997e31c req-9611a268-ad01-49a4-a560-e68782ce212c tempest-AttachSCSIVolumeTestJSON-1798094222 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4/luns/v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a6fe4b60-0ecd-4422-9ede-418ee997e31c req-9611a268-ad01-49a4-a560-e68782ce212c tempest-AttachSCSIVolumeTestJSON-1798094222 None] delete target: iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:00:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a6fe4b60-0ecd-4422-9ede-418ee997e31c req-9611a268-ad01-49a4-a560-e68782ce212c tempest-AttachSCSIVolumeTestJSON-1798094222 None] delete target iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:00:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a6fe4b60-0ecd-4422-9ede-418ee997e31c req-9611a268-ad01-49a4-a560-e68782ce212c tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a6fe4b60-0ecd-4422-9ede-418ee997e31c req-9611a268-ad01-49a4-a560-e68782ce212c tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a6fe4b60-0ecd-4422-9ede-418ee997e31c req-9611a268-ad01-49a4-a560-e68782ce212c tempest-AttachSCSIVolumeTestJSON-1798094222 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a6fe4b60-0ecd-4422-9ede-418ee997e31c req-9611a268-ad01-49a4-a560-e68782ce212c tempest-AttachSCSIVolumeTestJSON-1798094222 None] target iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:00:42 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=14,cinder:UPDATE=4 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:00:42 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=54,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:00:56 user cinder-volume[73403]: DEBUG cinder.coordination [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Acquiring lock "cinder-d9358de3-07e9-437f-983f-50a585699a89-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:00:56 user cinder-volume[73403]: DEBUG cinder.coordination [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Lock "cinder-d9358de3-07e9-437f-983f-50a585699a89-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:00:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] remove_export for volume: d9358de3-07e9-437f-983f-50a585699a89. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:00:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:00:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1865978163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d9358de3-07e9-437f-983f-50a585699a89,launched_at=2023-04-14T02:59:57Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cec85cd4364c8eaad6870b92249a56',provider_auth='CHAP noqgYikX CDaikjQbRurT4p',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:59:55Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:00:56Z,updated_at=2023-04-14T03:00:56Z,use_quota=True,user_id='70eb1e59ba1342688a8ce4e6ff440f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:00:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] detach volume v_d9358de3-07e9-437f-983f-50a585699a89 from target iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:00:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89/luns/v_d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89/luns/v_d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89/luns/v_d9358de3-07e9-437f-983f-50a585699a89'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89/luns/v_d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] failed to remove resource iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 because of JDSS resource v_d9358de3-07e9-437f-983f-50a585699a89 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:00:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] delete target: iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:00:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] delete target iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:00:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] failed to remove resource iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 because of JDSS resource iqn.2010-10.org.openstack:d9358de3-07e9-437f-983f-50a585699a89 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:00:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] deleating volume v_d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:00:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] get snapshots for volume v_d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:00:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d9358de3-07e9-437f-983f-50a585699a89/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d9358de3-07e9-437f-983f-50a585699a89/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d9358de3-07e9-437f-983f-50a585699a89/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] get volume v_d9358de3-07e9-437f-983f-50a585699a89 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:00:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d9358de3-07e9-437f-983f-50a585699a89', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442605', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112733', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5561124834760038242', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '842f70cd9f433895', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276868096', 'san:volume_id': '842f70cd9f4338950fbc5b2c17b2e649176275f0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85571', 'name': 'v_d9358de3-07e9-437f-983f-50a585699a89', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] delete volume:v_d9358de3-07e9-437f-983f-50a585699a89 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:00:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d9358de3-07e9-437f-983f-50a585699a89 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] volume v_d9358de3-07e9-437f-983f-50a585699a89 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:00:58 user cinder-volume[73403]: DEBUG cinder.quota [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Created reservations ['6753bf33-f5ea-4559-bc14-19f670b576ae', 'fb205994-c6e8-4c97-bfdf-89c325d58cca', 'f5414a00-7091-468f-8349-2e42eb70814f', '1ab0e00d-2d26-4f7c-9674-9d7a548306ed'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:00:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:00:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:00:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:00:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:00:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276937728', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:00:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:00:59 user cinder-volume[73403]: DEBUG cinder.manager [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:00:59 user cinder-volume[73403]: INFO cinder.volume.manager [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Deleted volume successfully. Apr 14 03:00:59 user cinder-volume[73403]: DEBUG cinder.coordination [None req-964c2174-8678-473a-9d25-ad423ce87397 tempest-DeleteServersTestJSON-360109579 None] Lock "cinder-d9358de3-07e9-437f-983f-50a585699a89-delete_volume" released by "delete_volume" :: held 3.283s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:01:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=14,cinder:UPDATE=9 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=21,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] create export for volume: edd92bd4-26a2-4652-bdc6-77805711142a. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:01:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] ensure volume edd92bd4-26a2-4652-bdc6-77805711142a assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:01:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] check if targe iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:01:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] create target and attach volume edd92bd4-26a2-4652-bdc6-77805711142a to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:01:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] create target iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:01:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:19 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:01:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Flow 'volume_create_manager' (748fab80-8f2f-4388-a4a9-83b9514e2381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:01:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221edea0-cc37-422c-99c8-6b6a3b47a280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221edea0-cc37-422c-99c8-6b6a3b47a280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-844414107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ba0a016e-f7ab-4aac-8fb3-ecf199678570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de2d10e0d7e7477484e4204841a3980c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:01:20Z,use_quota=True,user_id='c3c342144e51496190e32329225ddd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc2438e-0764-42b3-af22-c9a72823ba79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc2438e-0764-42b3-af22-c9a72823ba79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3930c561-cfa6-4f4c-9eb5-da7d4ddbfff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3930c561-cfa6-4f4c-9eb5-da7d4ddbfff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ba0a016e-f7ab-4aac-8fb3-ecf199678570', 'volume_name': 'volume-ba0a016e-f7ab-4aac-8fb3-ecf199678570', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b373518-7fb3-4f52-b1c0-8188abf584b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b373518-7fb3-4f52-b1c0-8188abf584b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1698c7e8-46dd-4127-b6d9-0fe3b06aa650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:19 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Volume ba0a016e-f7ab-4aac-8fb3-ecf199678570: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ba0a016e-f7ab-4aac-8fb3-ecf199678570', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 03:01:19 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Cloning ba0a016e-f7ab-4aac-8fb3-ecf199678570 from image 98e6a247-250b-4bb5-a947-e7f93598d16e at location (None, None). {{(pid=73403) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 03:01:19 user cinder-volume[73403]: DEBUG cinder.coordination [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Acquiring lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" by "_prepare_image_cache_entry" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:01:19 user cinder-volume[73403]: DEBUG cinder.coordination [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:01:19 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 3, 1, 19, 980929)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 03:01:19 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 03:01:19 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Found cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 03:01:19 user cinder-volume[73403]: DEBUG cinder.coordination [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" released by "_prepare_image_cache_entry" :: held 0.017s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:01:19 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Attempting to retrieve cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 03:01:20 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 3, 1, 19, 997632)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 03:01:20 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 03:01:20 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Creating from source image-volume 482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 03:01:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] cloned volume 482f938f-083c-4221-99f8-3320a80b8725 to ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 03:01:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] cloning v_482f938f-083c-4221-99f8-3320a80b8725 to v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:01:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] create snapshot v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:01:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:20 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Acquiring lock "cinder-e898aaea-41c4-4fc9-ac07-5d27f62094c4-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:01:20 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Lock "cinder-e898aaea-41c4-4fc9-ac07-5d27f62094c4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:01:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] remove_export for volume: e898aaea-41c4-4fc9-ac07-5d27f62094c4. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:01:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:01:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-816542445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e898aaea-41c4-4fc9-ac07-5d27f62094c4,launched_at=2023-04-14T03:00:19Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcbeb4e2fdc1420c98c264aac62340a7',provider_auth='CHAP vmqUDaix kISTOEx14nLQ96',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:00:18Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:01:21Z,updated_at=2023-04-14T03:01:21Z,use_quota=True,user_id='9eabf8254cde4d86a1862934ec9b5240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:01:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] detach volume v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 from target iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:01:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4/luns/v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4/luns/v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4/luns/v_e898aaea-41c4-4fc9-ac07-5d27f62094c4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4/luns/v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] failed to remove resource iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 because of JDSS resource v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] delete target: iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] delete target iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] failed to remove resource iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 because of JDSS resource iqn.2010-10.org.openstack:e898aaea-41c4-4fc9-ac07-5d27f62094c4 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] deleating volume v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] get snapshots for volume v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e898aaea-41c4-4fc9-ac07-5d27f62094c4/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e898aaea-41c4-4fc9-ac07-5d27f62094c4/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_ba0a016e-f7ab-4aac-8fb3-ecf199678570'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] create volume v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 from snapshot v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] atach volume v_edd92bd4-26a2-4652-bdc6-77805711142a to target iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e898aaea-41c4-4fc9-ac07-5d27f62094c4/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] get volume v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e898aaea-41c4-4fc9-ac07-5d27f62094c4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442627', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112752', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9579697138524729656', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a393c99fcbc4529b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276900864', 'san:volume_id': 'a393c99fcbc4529bf74dbe6c5ae162fb74feaa3e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84457', 'name': 'v_e898aaea-41c4-4fc9-ac07-5d27f62094c4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] delete volume:v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_ba0a016e-f7ab-4aac-8fb3-ecf199678570', 'is_clone': True, 'full_name': 'Pool-0/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570', 'name': 'v_ba0a016e-f7ab-4aac-8fb3-ecf199678570'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] get volume v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:01:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_ba0a016e-f7ab-4aac-8fb3-ecf199678570', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442690', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '112773', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5409191627996667760', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a665d51b2c319510', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276900864', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85051', 'name': 'v_ba0a016e-f7ab-4aac-8fb3-ecf199678570', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:22 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Marking volume ba0a016e-f7ab-4aac-8fb3-ecf199678570 as bootable. {{(pid=73403) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 03:01:22 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Copying metadata from image 98e6a247-250b-4bb5-a947-e7f93598d16e to ba0a016e-f7ab-4aac-8fb3-ecf199678570. {{(pid=73403) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 03:01:22 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Creating volume glance metadata for volume ba0a016e-f7ab-4aac-8fb3-ecf199678570 backed by image 98e6a247-250b-4bb5-a947-e7f93598d16e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73403) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 03:01:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1698c7e8-46dd-4127-b6d9-0fe3b06aa650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba0a016e-f7ab-4aac-8fb3-ecf199678570', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ebf6f7-d612-41ed-81d0-a52013cd5053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:22 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Volume volume-ba0a016e-f7ab-4aac-8fb3-ecf199678570 (ba0a016e-f7ab-4aac-8fb3-ecf199678570): created successfully Apr 14 03:01:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ebf6f7-d612-41ed-81d0-a52013cd5053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Flow 'volume_create_manager' (748fab80-8f2f-4388-a4a9-83b9514e2381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:01:22 user cinder-volume[73403]: INFO cinder.volume.manager [None req-141ac379-0d3d-401e-9142-522893578cd7 tempest-TaggedBootDevicesTest-226254012 None] Created volume successfully. Apr 14 03:01:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3062393431376364', 'lun': 0, 'mode': 'wt', 'name': 'v_edd92bd4-26a2-4652-bdc6-77805711142a', 'prod_id': 'Storage', 'scsi_id': '0b9417cd4f99bcc2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] add credentails to target iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:01:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] Geting {'code': 201, 'error': None, 'data': {'name': 'kXtdrAGB'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] initialize_connection for edd92bd4-26a2-4652-bdc6-77805711142a 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kXtdrAGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'a532a8a2-f086-40cb-8ce1-d9a8b50a753f'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:01:23 user cinder-volume[73403]: INFO cinder.volume.manager [req-50a8fbda-d9b1-4e0e-b933-627604850134 req-9a255af9-eb2f-4c99-b0a8-01a91ee96d23 tempest-TestStampPattern-323884970 None] attachment_update completed successfully. Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] volume v_e898aaea-41c4-4fc9-ac07-5d27f62094c4 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.quota [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Created reservations ['7b48ce55-5d30-4bc9-9d68-5a0d4c3ef99c', 'cbe97bc2-104c-4071-8db6-ec3272751486', '943fbf6b-2056-4757-b28f-b11b1891e6cb', '95f636c7-278f-4c06-9f19-5bac817b54ab'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Flow 'volume_create_manager' (3e99ea91-22a9-495f-bf7f-a3e2c71d9764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98bbbfb3-12f9-445f-9883-cc45cdfbe141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98bbbfb3-12f9-445f-9883-cc45cdfbe141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1976350653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=453b7855-8efd-41bd-806c-18ae2c03ac49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de2d10e0d7e7477484e4204841a3980c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:01:23Z,use_quota=True,user_id='c3c342144e51496190e32329225ddd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585ff054-49ec-4cff-be63-d11b7281a76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585ff054-49ec-4cff-be63-d11b7281a76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666a6207-f76b-4487-b0f8-95f97b32cbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666a6207-f76b-4487-b0f8-95f97b32cbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '453b7855-8efd-41bd-806c-18ae2c03ac49', 'volume_name': 'volume-453b7855-8efd-41bd-806c-18ae2c03ac49', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2651158c-47a4-43a8-b5b2-a328fd1dd759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2651158c-47a4-43a8-b5b2-a328fd1dd759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6190fc16-1e1a-48d4-8d20-412d1c097a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:23 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Volume 453b7855-8efd-41bd-806c-18ae2c03ac49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-453b7855-8efd-41bd-806c-18ae2c03ac49', 'volume_size': 1} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] creating volume v_453b7855-8efd-41bd-806c-18ae2c03ac49. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] create volume {'name': 'v_453b7855-8efd-41bd-806c-18ae2c03ac49', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276970496', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:01:24 user cinder-volume[73403]: DEBUG cinder.manager [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:01:24 user cinder-volume[73403]: INFO cinder.volume.manager [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Deleted volume successfully. Apr 14 03:01:24 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7856792f-d3d4-4f21-9a39-f724eec6087d tempest-AttachSCSIVolumeTestJSON-1798094222 None] Lock "cinder-e898aaea-41c4-4fc9-ac07-5d27f62094c4-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:01:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_453b7855-8efd-41bd-806c-18ae2c03ac49', 'is_clone': False, 'name': 'v_453b7855-8efd-41bd-806c-18ae2c03ac49'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6190fc16-1e1a-48d4-8d20-412d1c097a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-453b7855-8efd-41bd-806c-18ae2c03ac49', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41a7762-0db5-4397-8dc8-e3255fcf2fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:24 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Volume volume-453b7855-8efd-41bd-806c-18ae2c03ac49 (453b7855-8efd-41bd-806c-18ae2c03ac49): created successfully Apr 14 03:01:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41a7762-0db5-4397-8dc8-e3255fcf2fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Flow 'volume_create_manager' (3e99ea91-22a9-495f-bf7f-a3e2c71d9764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:01:24 user cinder-volume[73403]: INFO cinder.volume.manager [None req-3c6ec561-6619-41fa-8945-9bc720cde00b tempest-TaggedBootDevicesTest-226254012 None] Created volume successfully. Apr 14 03:01:25 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:01:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Flow 'volume_create_manager' (c0499d05-7f91-4288-9048-70a8f0db868e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:01:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d05d91-e4ca-480e-a330-a9cdc105dd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d05d91-e4ca-480e-a330-a9cdc105dd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1814896836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c11ac81e-755b-4855-85b5-259c815fef2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de2d10e0d7e7477484e4204841a3980c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:01:26Z,use_quota=True,user_id='c3c342144e51496190e32329225ddd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ec4ad8-c228-4235-b0c2-cab532195a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ec4ad8-c228-4235-b0c2-cab532195a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290a0568-f042-4342-92af-b245eeb8e877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290a0568-f042-4342-92af-b245eeb8e877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c11ac81e-755b-4855-85b5-259c815fef2c', 'volume_name': 'volume-c11ac81e-755b-4855-85b5-259c815fef2c', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55730d54-780c-4ca6-8f01-33ef6cc628f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55730d54-780c-4ca6-8f01-33ef6cc628f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee0c4c9-5cdd-47cb-85e6-6537250f4d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:25 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Volume c11ac81e-755b-4855-85b5-259c815fef2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c11ac81e-755b-4855-85b5-259c815fef2c', 'volume_size': 1} Apr 14 03:01:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] creating volume v_c11ac81e-755b-4855-85b5-259c815fef2c. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:01:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] create volume {'name': 'v_c11ac81e-755b-4855-85b5-259c815fef2c', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:01:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c11ac81e-755b-4855-85b5-259c815fef2c', 'is_clone': False, 'name': 'v_c11ac81e-755b-4855-85b5-259c815fef2c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee0c4c9-5cdd-47cb-85e6-6537250f4d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c11ac81e-755b-4855-85b5-259c815fef2c', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db150385-02da-49c6-97c9-3cbb780d83bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:27 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Volume volume-c11ac81e-755b-4855-85b5-259c815fef2c (c11ac81e-755b-4855-85b5-259c815fef2c): created successfully Apr 14 03:01:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db150385-02da-49c6-97c9-3cbb780d83bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Flow 'volume_create_manager' (c0499d05-7f91-4288-9048-70a8f0db868e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:01:27 user cinder-volume[73403]: INFO cinder.volume.manager [None req-f84986d6-3e73-43a5-867b-8f1519d5b260 tempest-TaggedBootDevicesTest-226254012 None] Created volume successfully. Apr 14 03:01:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 req-05eafedf-7648-4542-9cc6-54889886aba5 tempest-TestStampPattern-323884970 None] terminate connection for edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:01:28 user cinder-volume[73403]: INFO cinder.volume.manager [req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 req-05eafedf-7648-4542-9cc6-54889886aba5 tempest-TestStampPattern-323884970 None] Terminate volume connection completed successfully. Apr 14 03:01:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 req-05eafedf-7648-4542-9cc6-54889886aba5 tempest-TestStampPattern-323884970 None] Deleting attachment a532a8a2-f086-40cb-8ce1-d9a8b50a753f. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:01:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 req-05eafedf-7648-4542-9cc6-54889886aba5 tempest-TestStampPattern-323884970 None] remove_export for volume: edd92bd4-26a2-4652-bdc6-77805711142a. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:01:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 req-05eafedf-7648-4542-9cc6-54889886aba5 tempest-TestStampPattern-323884970 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:01:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 req-05eafedf-7648-4542-9cc6-54889886aba5 tempest-TestStampPattern-323884970 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1947376354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=edd92bd4-26a2-4652-bdc6-77805711142a,launched_at=2023-04-14T02:59:23Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='6371b4c05df843da9b134e12994c1d7a',provider_auth='CHAP kXtdrAGB PGoYaehFAzvdLM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:59:21Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:01:27Z,use_quota=True,user_id='337e2d8118324215b5a0baa36a5895b0',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:01:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 req-05eafedf-7648-4542-9cc6-54889886aba5 tempest-TestStampPattern-323884970 None] detach volume v_edd92bd4-26a2-4652-bdc6-77805711142a from target iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:01:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 req-05eafedf-7648-4542-9cc6-54889886aba5 tempest-TestStampPattern-323884970 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a/luns/v_edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 req-05eafedf-7648-4542-9cc6-54889886aba5 tempest-TestStampPattern-323884970 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a/luns/v_edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 req-05eafedf-7648-4542-9cc6-54889886aba5 tempest-TestStampPattern-323884970 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a/luns/v_edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 req-05eafedf-7648-4542-9cc6-54889886aba5 tempest-TestStampPattern-323884970 None] delete target: iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:01:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 req-05eafedf-7648-4542-9cc6-54889886aba5 tempest-TestStampPattern-323884970 None] delete target iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:01:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 req-05eafedf-7648-4542-9cc6-54889886aba5 tempest-TestStampPattern-323884970 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 req-05eafedf-7648-4542-9cc6-54889886aba5 tempest-TestStampPattern-323884970 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 req-05eafedf-7648-4542-9cc6-54889886aba5 tempest-TestStampPattern-323884970 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3f2f9345-9ca2-4a47-bcaf-9f3287ed6544 req-05eafedf-7648-4542-9cc6-54889886aba5 tempest-TestStampPattern-323884970 None] target iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:01:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-8bcbbbc5-680f-49ae-9e11-8059fb279d6d tempest-TestVolumeBootPattern-910285030 None] terminate connection for 47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:01:30 user cinder-volume[73403]: INFO cinder.volume.manager [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-8bcbbbc5-680f-49ae-9e11-8059fb279d6d tempest-TestVolumeBootPattern-910285030 None] Terminate volume connection completed successfully. Apr 14 03:01:30 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-8bcbbbc5-680f-49ae-9e11-8059fb279d6d tempest-TestVolumeBootPattern-910285030 None] Deleting attachment 9a5f6596-6d83-438b-bfae-fe7d1c5b35bf. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:01:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-8bcbbbc5-680f-49ae-9e11-8059fb279d6d tempest-TestVolumeBootPattern-910285030 None] remove_export for volume: 47e890f1-6257-486b-ab68-7d91ac9f65bf. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:01:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-8bcbbbc5-680f-49ae-9e11-8059fb279d6d tempest-TestVolumeBootPattern-910285030 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:01:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-8bcbbbc5-680f-49ae-9e11-8059fb279d6d tempest-TestVolumeBootPattern-910285030 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:59:38Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=47e890f1-6257-486b-ab68-7d91ac9f65bf,launched_at=2023-04-14T02:59:40Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='2d2e49e8e92e416faebf55e3d4e0e087',provider_auth='CHAP JcvzNKnb sboJQf1hdemRWr',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:59:38Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=ce95f5fe-2669-423c-8ac4-9edd6f1c5f54,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T02:59:50Z,use_quota=True,user_id='60e11b7ab2914209b23bf7a53791da64',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:01:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-8bcbbbc5-680f-49ae-9e11-8059fb279d6d tempest-TestVolumeBootPattern-910285030 None] detach volume v_47e890f1-6257-486b-ab68-7d91ac9f65bf from target iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:01:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-8bcbbbc5-680f-49ae-9e11-8059fb279d6d tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf/luns/v_47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-8bcbbbc5-680f-49ae-9e11-8059fb279d6d tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf/luns/v_47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-8bcbbbc5-680f-49ae-9e11-8059fb279d6d tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf/luns/v_47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-8bcbbbc5-680f-49ae-9e11-8059fb279d6d tempest-TestVolumeBootPattern-910285030 None] delete target: iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-8bcbbbc5-680f-49ae-9e11-8059fb279d6d tempest-TestVolumeBootPattern-910285030 None] delete target iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-8bcbbbc5-680f-49ae-9e11-8059fb279d6d tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-8bcbbbc5-680f-49ae-9e11-8059fb279d6d tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-8bcbbbc5-680f-49ae-9e11-8059fb279d6d tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-8bcbbbc5-680f-49ae-9e11-8059fb279d6d tempest-TestVolumeBootPattern-910285030 None] target iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.coordination [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Acquiring lock "cinder-47e890f1-6257-486b-ab68-7d91ac9f65bf-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.coordination [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-47e890f1-6257-486b-ab68-7d91ac9f65bf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] remove_export for volume: 47e890f1-6257-486b-ab68-7d91ac9f65bf. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:59:38Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=47e890f1-6257-486b-ab68-7d91ac9f65bf,launched_at=2023-04-14T02:59:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2e49e8e92e416faebf55e3d4e0e087',provider_auth='CHAP JcvzNKnb sboJQf1hdemRWr',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:59:38Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=ce95f5fe-2669-423c-8ac4-9edd6f1c5f54,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:01:32Z,updated_at=2023-04-14T03:01:32Z,use_quota=True,user_id='60e11b7ab2914209b23bf7a53791da64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] detach volume v_47e890f1-6257-486b-ab68-7d91ac9f65bf from target iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf/luns/v_47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf/luns/v_47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf/luns/v_47e890f1-6257-486b-ab68-7d91ac9f65bf'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf/luns/v_47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] failed to remove resource iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf because of JDSS resource v_47e890f1-6257-486b-ab68-7d91ac9f65bf DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] delete target: iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] delete target iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] failed to remove resource iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf because of JDSS resource iqn.2010-10.org.openstack:47e890f1-6257-486b-ab68-7d91ac9f65bf DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] deleating volume v_47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] get snapshots for volume v_47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47e890f1-6257-486b-ab68-7d91ac9f65bf/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47e890f1-6257-486b-ab68-7d91ac9f65bf/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47e890f1-6257-486b-ab68-7d91ac9f65bf/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] get volume v_47e890f1-6257-486b-ab68-7d91ac9f65bf info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:01:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54@v_47e890f1-6257-486b-ab68-7d91ac9f65bf', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_47e890f1-6257-486b-ab68-7d91ac9f65bf', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442588', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26107904', 'sharesmb': None, 'createtxg': '112715', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12397934117239551544', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10129408', 'logicalused': '25899008', 'compressratio': '2.57', 'rootcontext': 'none', 'default_scsi_id': '8a293c3d4c1dbbfe', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276675584', 'san:volume_id': '8a293c3d4c1dbbfe7ea8b10cb359bb0e5beb153d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10129408', 'objsetid': '85547', 'name': 'v_47e890f1-6257-486b-ab68-7d91ac9f65bf', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10129408', 'logicalreferenced': '43593728', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] delete snapshot v_47e890f1-6257-486b-ab68-7d91ac9f65bf of volume s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:01:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54/snapshots/v_47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54/snapshots/v_47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54/snapshots/v_47e890f1-6257-486b-ab68-7d91ac9f65bf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] snapshot v_47e890f1-6257-486b-ab68-7d91ac9f65bf deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:01:34 user cinder-volume[73403]: DEBUG cinder.quota [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Created reservations ['d48d0210-7faa-4a89-924e-6e951cd7ee64', '41371064-e309-4357-a935-046a60d8fe59', '76f23df3-d691-48f4-96b9-aaa2d1ce691b', 'c9071b84-cb2e-4b10-81fd-6acd0a66da67'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:01:34 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=65,cinder:UPDATE=21,cinder:INSERT=12,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:34 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=66,cinder:UPDATE=24,cinder:INSERT=8,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:01:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:01:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:01:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'available': '114286854144', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:01:35 user cinder-volume[73403]: DEBUG cinder.manager [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:01:35 user cinder-volume[73403]: INFO cinder.volume.manager [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Deleted volume successfully. Apr 14 03:01:35 user cinder-volume[73403]: DEBUG cinder.coordination [req-f59106a4-de65-4fbb-b377-2adee8c2f4cb req-704ca150-9d05-4005-bb43-3bcabb56fe91 tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-47e890f1-6257-486b-ab68-7d91ac9f65bf-delete_volume" released by "delete_volume" :: held 3.684s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:01:42 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:01:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Flow 'volume_create_manager' (5b279b82-aec0-484b-9f4d-0d6485251cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:01:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bad0950-2993-41f4-acb4-c33ca66c752b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bad0950-2993-41f4-acb4-c33ca66c752b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-324770688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f0c626e1-cd60-46d3-b894-a000a5cb3811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4075885e26cb4adaad24d3ae6217fe35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:01:43Z,use_quota=True,user_id='7dea23743ba945c4a9d539b8e277c653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eed11f3-3a35-4f4f-b5c4-38d359bc07ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eed11f3-3a35-4f4f-b5c4-38d359bc07ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09053d8-ce51-462d-98bb-283e583fa345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09053d8-ce51-462d-98bb-283e583fa345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0c626e1-cd60-46d3-b894-a000a5cb3811', 'volume_name': 'volume-f0c626e1-cd60-46d3-b894-a000a5cb3811', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90358a6-fff3-41b2-ae68-16210db7e475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90358a6-fff3-41b2-ae68-16210db7e475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d27df8-1203-4f15-8538-8a1d3962fad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:42 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Volume f0c626e1-cd60-46d3-b894-a000a5cb3811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0c626e1-cd60-46d3-b894-a000a5cb3811', 'volume_size': 1} Apr 14 03:01:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] creating volume v_f0c626e1-cd60-46d3-b894-a000a5cb3811. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:01:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] create volume {'name': 'v_f0c626e1-cd60-46d3-b894-a000a5cb3811', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:01:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_f0c626e1-cd60-46d3-b894-a000a5cb3811', 'is_clone': False, 'name': 'v_f0c626e1-cd60-46d3-b894-a000a5cb3811'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d27df8-1203-4f15-8538-8a1d3962fad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0c626e1-cd60-46d3-b894-a000a5cb3811', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4507778-62f2-42fc-9ae8-7da0e3967f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:44 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Volume volume-f0c626e1-cd60-46d3-b894-a000a5cb3811 (f0c626e1-cd60-46d3-b894-a000a5cb3811): created successfully Apr 14 03:01:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4507778-62f2-42fc-9ae8-7da0e3967f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Flow 'volume_create_manager' (5b279b82-aec0-484b-9f4d-0d6485251cca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:01:44 user cinder-volume[73403]: INFO cinder.volume.manager [None req-1d2f652c-4934-4b6a-a620-48100e48d994 tempest-ServerActionsTestJSON-1848627478 None] Created volume successfully. Apr 14 03:01:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] create export for volume: ba0a016e-f7ab-4aac-8fb3-ecf199678570. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:01:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] ensure volume ba0a016e-f7ab-4aac-8fb3-ecf199678570 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:01:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] check if targe iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:01:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] create target and attach volume ba0a016e-f7ab-4aac-8fb3-ecf199678570 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:01:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] create target iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:01:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] create export for volume: f0c626e1-cd60-46d3-b894-a000a5cb3811. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:01:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] ensure volume f0c626e1-cd60-46d3-b894-a000a5cb3811 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:01:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] check if targe iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:01:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] create target and attach volume f0c626e1-cd60-46d3-b894-a000a5cb3811 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:01:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] create target iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:01:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] atach volume v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 to target iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:01:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Flow 'volume_create_manager' (81b35631-7433-4263-b338-385b271cf084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493eb712-3de8-4e24-83b3-eb920204939c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493eb712-3de8-4e24-83b3-eb920204939c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1687729802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0032d61d-2851-4bde-b7cd-42043f3b1a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f987064bf0ed4a2fa8714064fe8b43c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:01:49Z,use_quota=True,user_id='f089c5c093754f8082181a8fc1c002f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bacc549-9492-426f-966a-617af6838346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bacc549-9492-426f-966a-617af6838346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb43a957-7132-469f-8e04-017fb2e60193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb43a957-7132-469f-8e04-017fb2e60193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0032d61d-2851-4bde-b7cd-42043f3b1a7f', 'volume_name': 'volume-0032d61d-2851-4bde-b7cd-42043f3b1a7f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5745e6fa-7e59-4764-83fd-cb4a0183ef25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5745e6fa-7e59-4764-83fd-cb4a0183ef25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50350e5-390c-4e21-9772-632b56864f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:48 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Volume 0032d61d-2851-4bde-b7cd-42043f3b1a7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0032d61d-2851-4bde-b7cd-42043f3b1a7f', 'volume_size': 1} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] creating volume v_0032d61d-2851-4bde-b7cd-42043f3b1a7f. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] create volume {'name': 'v_0032d61d-2851-4bde-b7cd-42043f3b1a7f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] atach volume v_f0c626e1-cd60-46d3-b894-a000a5cb3811 to target iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6136363564353162', 'lun': 0, 'mode': 'wt', 'name': 'v_ba0a016e-f7ab-4aac-8fb3-ecf199678570', 'prod_id': 'Storage', 'scsi_id': 'a665d51b2c319510'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] add credentails to target iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 201, 'error': None, 'data': {'name': 'VlDJEXwv'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] initialize_connection for ba0a016e-f7ab-4aac-8fb3-ecf199678570 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:01:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VlDJEXwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '7bc346aa-0798-431e-9e3c-58701616304e'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:01:49 user cinder-volume[73403]: INFO cinder.volume.manager [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-8508370b-8820-4adc-96a7-96a316208cf8 tempest-TaggedBootDevicesTest-226254012 None] attachment_update completed successfully. Apr 14 03:01:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] create export for volume: 453b7855-8efd-41bd-806c-18ae2c03ac49. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:01:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] ensure volume 453b7855-8efd-41bd-806c-18ae2c03ac49 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:01:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] check if targe iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:01:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] create target and attach volume 453b7855-8efd-41bd-806c-18ae2c03ac49 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:01:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] create target iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:01:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f', 'is_clone': False, 'name': 'v_0032d61d-2851-4bde-b7cd-42043f3b1a7f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50350e5-390c-4e21-9772-632b56864f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0032d61d-2851-4bde-b7cd-42043f3b1a7f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83d82968-cb77-4c21-a028-b7c3b452f8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:49 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Volume volume-0032d61d-2851-4bde-b7cd-42043f3b1a7f (0032d61d-2851-4bde-b7cd-42043f3b1a7f): created successfully Apr 14 03:01:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83d82968-cb77-4c21-a028-b7c3b452f8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Flow 'volume_create_manager' (81b35631-7433-4263-b338-385b271cf084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:01:49 user cinder-volume[73403]: INFO cinder.volume.manager [None req-51797c26-c6d4-4e83-a7c8-fdd0108f0c24 tempest-TestVolumeSwap-1328008515 None] Created volume successfully. Apr 14 03:01:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6336373965373062', 'lun': 0, 'mode': 'wt', 'name': 'v_f0c626e1-cd60-46d3-b894-a000a5cb3811', 'prod_id': 'Storage', 'scsi_id': 'c679e70b664dba58'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] add credentails to target iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:01:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'name': 'cpDvVdUM'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] initialize_connection for f0c626e1-cd60-46d3-b894-a000a5cb3811 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:01:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cpDvVdUM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '23f3e358-cbc4-4ae7-935e-d761f2bdeb3f'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:01:50 user cinder-volume[73403]: INFO cinder.volume.manager [req-29f8a1f8-b1d4-42cd-8c2c-5f0368646eed req-9b7c9e59-a09e-4aa0-98b1-88a5868f6ba6 tempest-ServerActionsTestJSON-1848627478 None] attachment_update completed successfully. Apr 14 03:01:50 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:01:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Flow 'volume_create_manager' (a5b48950-dc9b-4194-8b59-fbada739bb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:01:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc99a63-34ef-4f9b-bc44-17270e657c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc99a63-34ef-4f9b-bc44-17270e657c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1171189618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=80d66b06-08ad-4e2d-b0b7-5906492cd660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f987064bf0ed4a2fa8714064fe8b43c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:01:51Z,use_quota=True,user_id='f089c5c093754f8082181a8fc1c002f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1899a8-440e-418d-ad97-92550a5415ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1899a8-440e-418d-ad97-92550a5415ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12df040-26e7-4b39-bd66-972e2c0bfd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12df040-26e7-4b39-bd66-972e2c0bfd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d66b06-08ad-4e2d-b0b7-5906492cd660', 'volume_name': 'volume-80d66b06-08ad-4e2d-b0b7-5906492cd660', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9dc6112-e1f3-4b6f-8a46-fc7f76ed4397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9dc6112-e1f3-4b6f-8a46-fc7f76ed4397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760f1578-40f0-4cdb-be0f-e13bcb51f087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:51 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Volume 80d66b06-08ad-4e2d-b0b7-5906492cd660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d66b06-08ad-4e2d-b0b7-5906492cd660', 'volume_size': 1} Apr 14 03:01:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] creating volume v_80d66b06-08ad-4e2d-b0b7-5906492cd660. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:01:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] create volume {'name': 'v_80d66b06-08ad-4e2d-b0b7-5906492cd660', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:01:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_80d66b06-08ad-4e2d-b0b7-5906492cd660', 'is_clone': False, 'name': 'v_80d66b06-08ad-4e2d-b0b7-5906492cd660'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760f1578-40f0-4cdb-be0f-e13bcb51f087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d66b06-08ad-4e2d-b0b7-5906492cd660', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5cd2ea-5f42-4e1d-b947-bf7661618dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:01:52 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Volume volume-80d66b06-08ad-4e2d-b0b7-5906492cd660 (80d66b06-08ad-4e2d-b0b7-5906492cd660): created successfully Apr 14 03:01:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5cd2ea-5f42-4e1d-b947-bf7661618dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:01:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Flow 'volume_create_manager' (a5b48950-dc9b-4194-8b59-fbada739bb71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:01:52 user cinder-volume[73403]: INFO cinder.volume.manager [None req-c4037ec1-847a-411d-adbf-ff16378881e8 tempest-TestVolumeSwap-1328008515 None] Created volume successfully. Apr 14 03:01:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] atach volume v_453b7855-8efd-41bd-806c-18ae2c03ac49 to target iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:01:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6135343664376261', 'lun': 0, 'mode': 'wt', 'name': 'v_453b7855-8efd-41bd-806c-18ae2c03ac49', 'prod_id': 'Storage', 'scsi_id': 'a546d7ba27d1bbb1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] add credentails to target iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:01:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 201, 'error': None, 'data': {'name': 'KgfYmwnl'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] initialize_connection for 453b7855-8efd-41bd-806c-18ae2c03ac49 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:01:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KgfYmwnl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '897df238-c72c-46c7-80f3-6844d072066a'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:01:54 user cinder-volume[73403]: INFO cinder.volume.manager [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-177bf9e7-4081-43b9-be06-392322f1159b tempest-TaggedBootDevicesTest-226254012 None] attachment_update completed successfully. Apr 14 03:01:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] create export for volume: c11ac81e-755b-4855-85b5-259c815fef2c. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:01:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] ensure volume c11ac81e-755b-4855-85b5-259c815fef2c assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:01:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] check if targe iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:01:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] create target and attach volume c11ac81e-755b-4855-85b5-259c815fef2c to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:01:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] create target iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:01:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-a4e9ee57-368d-4df8-98c1-ab4bf3a17d83 tempest-ServerActionsTestJSON-1848627478 None] terminate connection for f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:01:57 user cinder-volume[73403]: INFO cinder.volume.manager [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-a4e9ee57-368d-4df8-98c1-ab4bf3a17d83 tempest-ServerActionsTestJSON-1848627478 None] Terminate volume connection completed successfully. Apr 14 03:01:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-a4e9ee57-368d-4df8-98c1-ab4bf3a17d83 tempest-ServerActionsTestJSON-1848627478 None] Deleting attachment 23f3e358-cbc4-4ae7-935e-d761f2bdeb3f. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:01:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-a4e9ee57-368d-4df8-98c1-ab4bf3a17d83 tempest-ServerActionsTestJSON-1848627478 None] remove_export for volume: f0c626e1-cd60-46d3-b894-a000a5cb3811. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:01:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-a4e9ee57-368d-4df8-98c1-ab4bf3a17d83 tempest-ServerActionsTestJSON-1848627478 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:01:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-a4e9ee57-368d-4df8-98c1-ab4bf3a17d83 tempest-ServerActionsTestJSON-1848627478 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-324770688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f0c626e1-cd60-46d3-b894-a000a5cb3811,launched_at=2023-04-14T03:01:44Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='4075885e26cb4adaad24d3ae6217fe35',provider_auth='CHAP cpDvVdUM bkHZ1xmYjIoWs5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:01:43Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:01:54Z,use_quota=True,user_id='7dea23743ba945c4a9d539b8e277c653',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:01:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-a4e9ee57-368d-4df8-98c1-ab4bf3a17d83 tempest-ServerActionsTestJSON-1848627478 None] detach volume v_f0c626e1-cd60-46d3-b894-a000a5cb3811 from target iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:01:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-a4e9ee57-368d-4df8-98c1-ab4bf3a17d83 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/luns/v_f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-a4e9ee57-368d-4df8-98c1-ab4bf3a17d83 tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/luns/v_f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-a4e9ee57-368d-4df8-98c1-ab4bf3a17d83 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/luns/v_f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-a4e9ee57-368d-4df8-98c1-ab4bf3a17d83 tempest-ServerActionsTestJSON-1848627478 None] delete target: iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:01:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-a4e9ee57-368d-4df8-98c1-ab4bf3a17d83 tempest-ServerActionsTestJSON-1848627478 None] delete target iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:01:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-a4e9ee57-368d-4df8-98c1-ab4bf3a17d83 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-a4e9ee57-368d-4df8-98c1-ab4bf3a17d83 tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-a4e9ee57-368d-4df8-98c1-ab4bf3a17d83 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-a4e9ee57-368d-4df8-98c1-ab4bf3a17d83 tempest-ServerActionsTestJSON-1848627478 None] target iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:01:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] atach volume v_c11ac81e-755b-4855-85b5-259c815fef2c to target iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:01:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] create export for volume: f0c626e1-cd60-46d3-b894-a000a5cb3811. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:01:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] ensure volume f0c626e1-cd60-46d3-b894-a000a5cb3811 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:01:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] check if targe iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:01:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] create target and attach volume f0c626e1-cd60-46d3-b894-a000a5cb3811 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:01:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] create target iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:01:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:01:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3036356436323332', 'lun': 0, 'mode': 'wt', 'name': 'v_c11ac81e-755b-4855-85b5-259c815fef2c', 'prod_id': 'Storage', 'scsi_id': '065d62323d0516eb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:01:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] add credentails to target iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:01:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:01:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 201, 'error': None, 'data': {'name': 'pGxcVBXE'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] initialize_connection for c11ac81e-755b-4855-85b5-259c815fef2c 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:02:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGxcVBXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'd1db064f-367e-4d97-a3dc-7007a652c17b'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:02:00 user cinder-volume[73403]: INFO cinder.volume.manager [req-33369a24-11d9-40ea-b360-1ce5344f0d6b req-04909fb0-c682-4acb-b766-e25170df06e3 tempest-TaggedBootDevicesTest-226254012 None] attachment_update completed successfully. Apr 14 03:02:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] atach volume v_f0c626e1-cd60-46d3-b894-a000a5cb3811 to target iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:02:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:02:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:02:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:02:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114286608384', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:02:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:02:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6336373965373062', 'lun': 0, 'mode': 'wt', 'name': 'v_f0c626e1-cd60-46d3-b894-a000a5cb3811', 'prod_id': 'Storage', 'scsi_id': 'c679e70b664dba58'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] add credentails to target iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:02:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'name': 'cpDvVdUM'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:04 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=71,cinder:UPDATE=14,cinder:DELETE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:04 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=64,cinder:UPDATE=26,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] initialize_connection for f0c626e1-cd60-46d3-b894-a000a5cb3811 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:02:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cpDvVdUM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'b82136c5-0a81-44df-924e-153ad5a7bedd'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:02:04 user cinder-volume[73403]: INFO cinder.volume.manager [req-b8231917-215f-42f7-b3f3-2057fb1c602b req-9311dd8f-6507-4946-b195-16ec57d6ff52 tempest-ServerActionsTestJSON-1848627478 None] attachment_update completed successfully. Apr 14 03:02:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cce27ae2-7de5-441f-ae7a-fb5689721baa tempest-TestStampPattern-323884970 None] create snapshot 3c3ed512-4929-421f-b8d6-cf222944553d for volume edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:02:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cce27ae2-7de5-441f-ae7a-fb5689721baa tempest-TestStampPattern-323884970 None] cloning v_edd92bd4-26a2-4652-bdc6-77805711142a to s_3c3ed512-4929-421f-b8d6-cf222944553d {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:02:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cce27ae2-7de5-441f-ae7a-fb5689721baa tempest-TestStampPattern-323884970 None] create snapshot s_3c3ed512-4929-421f-b8d6-cf222944553d {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:02:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cce27ae2-7de5-441f-ae7a-fb5689721baa tempest-TestStampPattern-323884970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd92bd4-26a2-4652-bdc6-77805711142a/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cce27ae2-7de5-441f-ae7a-fb5689721baa tempest-TestStampPattern-323884970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd92bd4-26a2-4652-bdc6-77805711142a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:18 user cinder-volume[73403]: DEBUG cinder.coordination [None req-11bd466c-7e97-4628-9c78-f8af6718ae3a tempest-TestVolumeBootPattern-910285030 None] Acquiring lock "cinder-ce95f5fe-2669-423c-8ac4-9edd6f1c5f54-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:02:18 user cinder-volume[73403]: DEBUG cinder.coordination [None req-11bd466c-7e97-4628-9c78-f8af6718ae3a tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-ce95f5fe-2669-423c-8ac4-9edd6f1c5f54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:02:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11bd466c-7e97-4628-9c78-f8af6718ae3a tempest-TestVolumeBootPattern-910285030 None] deleating snapshot s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:02:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11bd466c-7e97-4628-9c78-f8af6718ae3a tempest-TestVolumeBootPattern-910285030 None] get snapshots for volume s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:02:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11bd466c-7e97-4628-9c78-f8af6718ae3a tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11bd466c-7e97-4628-9c78-f8af6718ae3a tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cce27ae2-7de5-441f-ae7a-fb5689721baa tempest-TestStampPattern-323884970 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_3c3ed512-4929-421f-b8d6-cf222944553d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd92bd4-26a2-4652-bdc6-77805711142a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cce27ae2-7de5-441f-ae7a-fb5689721baa tempest-TestStampPattern-323884970 None] create volume s_3c3ed512-4929-421f-b8d6-cf222944553d from snapshot s_3c3ed512-4929-421f-b8d6-cf222944553d {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:02:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cce27ae2-7de5-441f-ae7a-fb5689721baa tempest-TestStampPattern-323884970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd92bd4-26a2-4652-bdc6-77805711142a/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cce27ae2-7de5-441f-ae7a-fb5689721baa tempest-TestStampPattern-323884970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd92bd4-26a2-4652-bdc6-77805711142a/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11bd466c-7e97-4628-9c78-f8af6718ae3a tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11bd466c-7e97-4628-9c78-f8af6718ae3a tempest-TestVolumeBootPattern-910285030 None] get volume s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:02:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11bd466c-7e97-4628-9c78-f8af6718ae3a tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11bd466c-7e97-4628-9c78-f8af6718ae3a tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11bd466c-7e97-4628-9c78-f8af6718ae3a tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c32c5b58-bb91-48df-a4b1-97d399d833ff@s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442583', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '112709', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7600058417789721548', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd4d824c6202b33e8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114286538752', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85531', 'name': 's_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11bd466c-7e97-4628-9c78-f8af6718ae3a tempest-TestVolumeBootPattern-910285030 None] delete snapshot s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54 of volume v_c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:02:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11bd466c-7e97-4628-9c78-f8af6718ae3a tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c32c5b58-bb91-48df-a4b1-97d399d833ff/snapshots/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11bd466c-7e97-4628-9c78-f8af6718ae3a tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c32c5b58-bb91-48df-a4b1-97d399d833ff/snapshots/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cce27ae2-7de5-441f-ae7a-fb5689721baa tempest-TestStampPattern-323884970 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_edd92bd4-26a2-4652-bdc6-77805711142a@s_3c3ed512-4929-421f-b8d6-cf222944553d', 'is_clone': True, 'full_name': 'Pool-0/s_3c3ed512-4929-421f-b8d6-cf222944553d', 'name': 's_3c3ed512-4929-421f-b8d6-cf222944553d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd92bd4-26a2-4652-bdc6-77805711142a/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cce27ae2-7de5-441f-ae7a-fb5689721baa tempest-TestStampPattern-323884970 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c3ed512-4929-421f-b8d6-cf222944553d/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cce27ae2-7de5-441f-ae7a-fb5689721baa tempest-TestStampPattern-323884970 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c3ed512-4929-421f-b8d6-cf222944553d/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cce27ae2-7de5-441f-ae7a-fb5689721baa tempest-TestStampPattern-323884970 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c3ed512-4929-421f-b8d6-cf222944553d/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cce27ae2-7de5-441f-ae7a-fb5689721baa tempest-TestStampPattern-323884970 None] volume s_3c3ed512-4929-421f-b8d6-cf222944553d properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:02:19 user cinder-volume[73403]: INFO cinder.volume.manager [None req-cce27ae2-7de5-441f-ae7a-fb5689721baa tempest-TestStampPattern-323884970 None] Create snapshot completed successfully Apr 14 03:02:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11bd466c-7e97-4628-9c78-f8af6718ae3a tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c32c5b58-bb91-48df-a4b1-97d399d833ff/snapshots/s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11bd466c-7e97-4628-9c78-f8af6718ae3a tempest-TestVolumeBootPattern-910285030 None] snapshot s_ce95f5fe-2669-423c-8ac4-9edd6f1c5f54 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:02:20 user cinder-volume[73403]: DEBUG cinder.quota [None req-11bd466c-7e97-4628-9c78-f8af6718ae3a tempest-TestVolumeBootPattern-910285030 None] Created reservations ['f5c290cf-c9bf-461a-b960-aa896ce00936', '3b41466f-8cfd-46e9-9463-6c24ef1f6759', 'ed9ee69a-9cb4-4acb-b2e1-fe7b731f2bc3', '86a4f103-d611-4928-9278-65cb402eae4b'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:02:20 user cinder-volume[73403]: INFO cinder.volume.manager [None req-11bd466c-7e97-4628-9c78-f8af6718ae3a tempest-TestVolumeBootPattern-910285030 None] Delete snapshot completed successfully. Apr 14 03:02:20 user cinder-volume[73403]: DEBUG cinder.coordination [None req-11bd466c-7e97-4628-9c78-f8af6718ae3a tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-ce95f5fe-2669-423c-8ac4-9edd6f1c5f54-delete_snapshot" released by "delete_snapshot" :: held 2.315s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:02:21 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Acquiring lock "cinder-c32c5b58-bb91-48df-a4b1-97d399d833ff-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:02:21 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-c32c5b58-bb91-48df-a4b1-97d399d833ff-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:02:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] remove_export for volume: c32c5b58-bb91-48df-a4b1-97d399d833ff. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:02:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:02:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-330078690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c32c5b58-bb91-48df-a4b1-97d399d833ff,launched_at=2023-04-14T02:59:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2e49e8e92e416faebf55e3d4e0e087',provider_auth='CHAP UdsuVngH dsGfznHyAeZFgv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c32c5b58-bb91-48df-a4b1-97d399d833ff 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:59:29Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:02:22Z,updated_at=2023-04-14T03:02:22Z,use_quota=True,user_id='60e11b7ab2914209b23bf7a53791da64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:c32c5b58-bb91-48df-a4b1-97d399d833ff. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:02:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] detach volume v_c32c5b58-bb91-48df-a4b1-97d399d833ff from target iqn.2010-10.org.openstack:c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:02:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c32c5b58-bb91-48df-a4b1-97d399d833ff/luns/v_c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c32c5b58-bb91-48df-a4b1-97d399d833ff/luns/v_c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c32c5b58-bb91-48df-a4b1-97d399d833ff not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c32c5b58-bb91-48df-a4b1-97d399d833ff/luns/v_c32c5b58-bb91-48df-a4b1-97d399d833ff'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c32c5b58-bb91-48df-a4b1-97d399d833ff/luns/v_c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] failed to remove resource iqn.2010-10.org.openstack:c32c5b58-bb91-48df-a4b1-97d399d833ff because of JDSS resource v_c32c5b58-bb91-48df-a4b1-97d399d833ff DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:02:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] delete target: iqn.2010-10.org.openstack:c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:02:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] delete target iqn.2010-10.org.openstack:c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:02:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c32c5b58-bb91-48df-a4b1-97d399d833ff not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c32c5b58-bb91-48df-a4b1-97d399d833ff'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] failed to remove resource iqn.2010-10.org.openstack:c32c5b58-bb91-48df-a4b1-97d399d833ff because of JDSS resource iqn.2010-10.org.openstack:c32c5b58-bb91-48df-a4b1-97d399d833ff DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:02:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] deleating volume v_c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:02:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] get snapshots for volume v_c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:02:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c32c5b58-bb91-48df-a4b1-97d399d833ff/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c32c5b58-bb91-48df-a4b1-97d399d833ff/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c32c5b58-bb91-48df-a4b1-97d399d833ff/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] get volume v_c32c5b58-bb91-48df-a4b1-97d399d833ff info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:02:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_c32c5b58-bb91-48df-a4b1-97d399d833ff', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c32c5b58-bb91-48df-a4b1-97d399d833ff', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442580', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '112703', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '558993242203041143', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a73861f8d68beaab', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114286526464', 'san:volume_id': 'a73861f8d68beaab9f788f47acb5b2586bd4f067', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85516', 'name': 'v_c32c5b58-bb91-48df-a4b1-97d399d833ff', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] delete snapshot v_c32c5b58-bb91-48df-a4b1-97d399d833ff of volume v_482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:02:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_c32c5b58-bb91-48df-a4b1-97d399d833ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] snapshot v_c32c5b58-bb91-48df-a4b1-97d399d833ff deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:02:24 user cinder-volume[73403]: DEBUG cinder.quota [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Created reservations ['433ec327-d48e-47ad-a485-e824e7df7778', 'a6cae31d-448a-4430-b3ca-62f91b96f098', '700041dd-439c-4139-a01b-2432f67339a3', '91d26a77-67c7-4983-bafb-f0e8ff3c402a'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:02:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:02:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:02:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'available': '114286575616', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.manager [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:02:25 user cinder-volume[73403]: INFO cinder.volume.manager [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Deleted volume successfully. Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e02e204d-0be7-4c27-9349-9558876a0958 tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-c32c5b58-bb91-48df-a4b1-97d399d833ff-delete_volume" released by "delete_volume" :: held 3.310s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Flow 'volume_create_manager' (d7b5fcce-9ce3-41cb-b6e3-55a5b76db5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41bbaa1e-1933-44f5-b50f-4efa74773f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41bbaa1e-1933-44f5-b50f-4efa74773f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1010389850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=37bd0d93-b922-426c-8986-d86e886da69e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2e49e8e92e416faebf55e3d4e0e087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:02:26Z,use_quota=True,user_id='60e11b7ab2914209b23bf7a53791da64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185f778e-048c-497d-9a96-839a3395e6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185f778e-048c-497d-9a96-839a3395e6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71483434-8972-422a-81e8-5beb9301280c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71483434-8972-422a-81e8-5beb9301280c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '37bd0d93-b922-426c-8986-d86e886da69e', 'volume_name': 'volume-37bd0d93-b922-426c-8986-d86e886da69e', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf9c9b5-c90e-45fc-8818-6fbfbc8b5f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf9c9b5-c90e-45fc-8818-6fbfbc8b5f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd9d426d-6bd9-45b3-a480-78f2223ae87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:02:25 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Volume 37bd0d93-b922-426c-8986-d86e886da69e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-37bd0d93-b922-426c-8986-d86e886da69e', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Cloning 37bd0d93-b922-426c-8986-d86e886da69e from image 98e6a247-250b-4bb5-a947-e7f93598d16e at location (None, None). {{(pid=73403) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.coordination [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Acquiring lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" by "_prepare_image_cache_entry" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.coordination [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 3, 2, 25, 735992)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Found cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.coordination [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Attempting to retrieve cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 3, 2, 25, 750633)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Creating from source image-volume 482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] cloned volume 482f938f-083c-4221-99f8-3320a80b8725 to 37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] cloning v_482f938f-083c-4221-99f8-3320a80b8725 to v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] create snapshot v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_37bd0d93-b922-426c-8986-d86e886da69e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] create volume v_37bd0d93-b922-426c-8986-d86e886da69e from snapshot v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:02:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_37bd0d93-b922-426c-8986-d86e886da69e', 'is_clone': True, 'full_name': 'Pool-0/v_37bd0d93-b922-426c-8986-d86e886da69e', 'name': 'v_37bd0d93-b922-426c-8986-d86e886da69e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] get volume v_37bd0d93-b922-426c-8986-d86e886da69e info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_37bd0d93-b922-426c-8986-d86e886da69e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_37bd0d93-b922-426c-8986-d86e886da69e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442756', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '112852', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9827443638577524303', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7601ba8b39e55d04', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114286551040', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84043', 'name': 'v_37bd0d93-b922-426c-8986-d86e886da69e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Marking volume 37bd0d93-b922-426c-8986-d86e886da69e as bootable. {{(pid=73403) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Copying metadata from image 98e6a247-250b-4bb5-a947-e7f93598d16e to 37bd0d93-b922-426c-8986-d86e886da69e. {{(pid=73403) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Creating volume glance metadata for volume 37bd0d93-b922-426c-8986-d86e886da69e backed by image 98e6a247-250b-4bb5-a947-e7f93598d16e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73403) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd9d426d-6bd9-45b3-a480-78f2223ae87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37bd0d93-b922-426c-8986-d86e886da69e', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50af016-0def-4d6e-b2e7-bbe6cc140acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:02:28 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Volume volume-37bd0d93-b922-426c-8986-d86e886da69e (37bd0d93-b922-426c-8986-d86e886da69e): created successfully Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50af016-0def-4d6e-b2e7-bbe6cc140acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Flow 'volume_create_manager' (d7b5fcce-9ce3-41cb-b6e3-55a5b76db5ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:02:28 user cinder-volume[73403]: INFO cinder.volume.manager [None req-58b5c7f5-0b19-4d2a-be0b-63085dd917e1 tempest-TestVolumeBootPattern-910285030 None] Created volume successfully. Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Flow 'volume_create_manager' (c1fb5b73-1b39-418d-85d9-4b0d9b17552c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4297bacc-eed4-4dab-a2c6-e0a52431eca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4297bacc-eed4-4dab-a2c6-e0a52431eca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-334653703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=95596aa7-5fd3-48b5-a091-0379a2e77fcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6371b4c05df843da9b134e12994c1d7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3c3ed512-4929-421f-b8d6-cf222944553d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:02:28Z,use_quota=True,user_id='337e2d8118324215b5a0baa36a5895b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94ac15d-3f1c-4b06-a2c5-5ee5d666ba1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94ac15d-3f1c-4b06-a2c5-5ee5d666ba1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2574605-0ecc-4188-9c64-3c71b826df34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2574605-0ecc-4188-9c64-3c71b826df34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '95596aa7-5fd3-48b5-a091-0379a2e77fcc', 'volume_name': 'volume-95596aa7-5fd3-48b5-a091-0379a2e77fcc', 'volume_size': 1, 'snapshot_id': '3c3ed512-4929-421f-b8d6-cf222944553d'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c952dc5-629c-43eb-970c-93ff9673e119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c952dc5-629c-43eb-970c-93ff9673e119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (459b7434-145a-49d1-99a2-e32a17d6242a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:02:28 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Volume 95596aa7-5fd3-48b5-a091-0379a2e77fcc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-95596aa7-5fd3-48b5-a091-0379a2e77fcc', 'volume_size': 1, 'snapshot_id': '3c3ed512-4929-421f-b8d6-cf222944553d'} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] create volume 95596aa7-5fd3-48b5-a091-0379a2e77fcc from snapshot 3c3ed512-4929-421f-b8d6-cf222944553d {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] cloning s_3c3ed512-4929-421f-b8d6-cf222944553d to v_95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] create snapshot v_95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c3ed512-4929-421f-b8d6-cf222944553d/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c3ed512-4929-421f-b8d6-cf222944553d/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_95596aa7-5fd3-48b5-a091-0379a2e77fcc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c3ed512-4929-421f-b8d6-cf222944553d/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] create volume v_95596aa7-5fd3-48b5-a091-0379a2e77fcc from snapshot v_95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:02:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c3ed512-4929-421f-b8d6-cf222944553d/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c3ed512-4929-421f-b8d6-cf222944553d/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_3c3ed512-4929-421f-b8d6-cf222944553d@v_95596aa7-5fd3-48b5-a091-0379a2e77fcc', 'is_clone': True, 'full_name': 'Pool-0/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc', 'name': 'v_95596aa7-5fd3-48b5-a091-0379a2e77fcc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c3ed512-4929-421f-b8d6-cf222944553d/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] get volume v_95596aa7-5fd3-48b5-a091-0379a2e77fcc info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:02:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_3c3ed512-4929-421f-b8d6-cf222944553d@v_95596aa7-5fd3-48b5-a091-0379a2e77fcc', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442759', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '163840', 'sharesmb': None, 'createtxg': '112859', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8886326466883264209', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0c8ed5eabe5f71ef', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276573184', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '15.30', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85098', 'name': 'v_95596aa7-5fd3-48b5-a091-0379a2e77fcc', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (459b7434-145a-49d1-99a2-e32a17d6242a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95596aa7-5fd3-48b5-a091-0379a2e77fcc', 'volume_size': 1, 'snapshot_id': '3c3ed512-4929-421f-b8d6-cf222944553d'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:02:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecfd9185-904f-4652-ad96-5dc7bc52983a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:02:31 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Volume volume-95596aa7-5fd3-48b5-a091-0379a2e77fcc (95596aa7-5fd3-48b5-a091-0379a2e77fcc): created successfully Apr 14 03:02:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecfd9185-904f-4652-ad96-5dc7bc52983a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:02:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Flow 'volume_create_manager' (c1fb5b73-1b39-418d-85d9-4b0d9b17552c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:02:31 user cinder-volume[73403]: INFO cinder.volume.manager [None req-f425ebf8-58fe-4ec4-8125-642b7806eb1e tempest-TestStampPattern-323884970 None] Created volume successfully. Apr 14 03:02:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] create export for volume: 37bd0d93-b922-426c-8986-d86e886da69e. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:02:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] ensure volume 37bd0d93-b922-426c-8986-d86e886da69e assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:02:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] check if targe iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:02:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] create target and attach volume 37bd0d93-b922-426c-8986-d86e886da69e to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:02:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] create target iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:02:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=68,cinder:UPDATE=19,cinder:INSERT=12,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] atach volume v_37bd0d93-b922-426c-8986-d86e886da69e to target iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:02:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3736303162613862', 'lun': 0, 'mode': 'wt', 'name': 'v_37bd0d93-b922-426c-8986-d86e886da69e', 'prod_id': 'Storage', 'scsi_id': '7601ba8b39e55d04'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] add credentails to target iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:02:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': {'name': 'YcTtkeKx'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:35 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=55,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=8 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:02:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] initialize_connection for 37bd0d93-b922-426c-8986-d86e886da69e 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:02:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcTtkeKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '1b28a89d-4544-49fc-afc0-487d95abdf46'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:02:36 user cinder-volume[73403]: INFO cinder.volume.manager [req-857e5d41-1823-4767-b53f-d73424560c86 req-d0fceb15-cc36-45b4-8557-76a5a1c768d5 tempest-TestVolumeBootPattern-910285030 None] attachment_update completed successfully. Apr 14 03:02:40 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:02:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Flow 'volume_create_manager' (111be18d-7975-4747-a88d-a9b27c122e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:02:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381b72e3-1448-4ce5-ac94-a1848dcc96d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:02:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381b72e3-1448-4ce5-ac94-a1848dcc96d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-634681456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c4f0f726-f20c-4b09-89f2-59415d36a8eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='558bfd7e1d9049d396381de148b0c4a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:02:40Z,use_quota=True,user_id='d5e8150f1502427fb3148f20354d212e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:02:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e32ebb-13d6-4dd7-9421-fce2e7e92f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:02:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e32ebb-13d6-4dd7-9421-fce2e7e92f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:02:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3f7561-9212-4f17-811f-6542c5ba12ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:02:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3f7561-9212-4f17-811f-6542c5ba12ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4f0f726-f20c-4b09-89f2-59415d36a8eb', 'volume_name': 'volume-c4f0f726-f20c-4b09-89f2-59415d36a8eb', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:02:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17be714-9308-4507-a2e8-6b542c696247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:02:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17be714-9308-4507-a2e8-6b542c696247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:02:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22cf6514-450e-4ad2-8495-6cee2a12b26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:02:40 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Volume c4f0f726-f20c-4b09-89f2-59415d36a8eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4f0f726-f20c-4b09-89f2-59415d36a8eb', 'volume_size': 1} Apr 14 03:02:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] creating volume v_c4f0f726-f20c-4b09-89f2-59415d36a8eb. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:02:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] create volume {'name': 'v_c4f0f726-f20c-4b09-89f2-59415d36a8eb', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:02:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:02:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:02:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c4f0f726-f20c-4b09-89f2-59415d36a8eb', 'is_clone': False, 'name': 'v_c4f0f726-f20c-4b09-89f2-59415d36a8eb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:02:41 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22cf6514-450e-4ad2-8495-6cee2a12b26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4f0f726-f20c-4b09-89f2-59415d36a8eb', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:02:41 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51b153a-3e67-43ef-969f-959a02a587f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:02:41 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Volume volume-c4f0f726-f20c-4b09-89f2-59415d36a8eb (c4f0f726-f20c-4b09-89f2-59415d36a8eb): created successfully Apr 14 03:02:41 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51b153a-3e67-43ef-969f-959a02a587f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:02:41 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Flow 'volume_create_manager' (111be18d-7975-4747-a88d-a9b27c122e29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:02:41 user cinder-volume[73403]: INFO cinder.volume.manager [None req-260e6501-77ce-4526-a049-2b43002de578 tempest-ServerRescueNegativeTestJSON-773851452 None] Created volume successfully. Apr 14 03:02:52 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=3,cinder:SELECT=12,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:01 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:03:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Flow 'volume_create_manager' (3eeb437a-6ba7-4a06-a221-cc2e001968d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:03:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1ce78c-738d-4777-a960-39c9bf74f204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:03:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1ce78c-738d-4777-a960-39c9bf74f204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1956703885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9f8127e3-8945-4981-8c0f-0796caa6a80c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94a1eb61159b43228db0d529a5be816d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:03:01Z,use_quota=True,user_id='f0d4916eb93c4b3ebbbd2af4b0cdacc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:03:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ccd201-1eef-4b42-8f66-07bf58f62dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:03:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ccd201-1eef-4b42-8f66-07bf58f62dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:03:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73957c2a-d537-40c0-aadb-7e951bc27ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:03:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73957c2a-d537-40c0-aadb-7e951bc27ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f8127e3-8945-4981-8c0f-0796caa6a80c', 'volume_name': 'volume-9f8127e3-8945-4981-8c0f-0796caa6a80c', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:03:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a1f039-6d6b-4447-8ebf-5b3bff5150ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:03:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a1f039-6d6b-4447-8ebf-5b3bff5150ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:03:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d584e14-5178-43eb-a546-fcaf0770d65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:03:01 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Volume 9f8127e3-8945-4981-8c0f-0796caa6a80c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f8127e3-8945-4981-8c0f-0796caa6a80c', 'volume_size': 1} Apr 14 03:03:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] creating volume v_9f8127e3-8945-4981-8c0f-0796caa6a80c. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:03:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] create volume {'name': 'v_9f8127e3-8945-4981-8c0f-0796caa6a80c', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:03:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9f8127e3-8945-4981-8c0f-0796caa6a80c', 'is_clone': False, 'name': 'v_9f8127e3-8945-4981-8c0f-0796caa6a80c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:02 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d584e14-5178-43eb-a546-fcaf0770d65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f8127e3-8945-4981-8c0f-0796caa6a80c', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:03:02 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681059ef-63db-4ac9-8c49-07b4150a4a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:03:02 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Volume volume-9f8127e3-8945-4981-8c0f-0796caa6a80c (9f8127e3-8945-4981-8c0f-0796caa6a80c): created successfully Apr 14 03:03:02 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681059ef-63db-4ac9-8c49-07b4150a4a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:03:02 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Flow 'volume_create_manager' (3eeb437a-6ba7-4a06-a221-cc2e001968d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:03:02 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8fd97ae8-48c3-432c-b897-74ef6001584e tempest-VolumesAdminNegativeTest-1232189050 None] Created volume successfully. Apr 14 03:03:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.coordination [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Acquiring lock "cinder-9f8127e3-8945-4981-8c0f-0796caa6a80c-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.coordination [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Lock "cinder-9f8127e3-8945-4981-8c0f-0796caa6a80c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=29,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] remove_export for volume: 9f8127e3-8945-4981-8c0f-0796caa6a80c. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1956703885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9f8127e3-8945-4981-8c0f-0796caa6a80c,launched_at=2023-04-14T03:03:02Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94a1eb61159b43228db0d529a5be816d',provider_auth='CHAP nlIvpBCZ Hlr0tAiJYs3Mhq',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8127e3-8945-4981-8c0f-0796caa6a80c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:03:01Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:03:04Z,updated_at=2023-04-14T03:03:04Z,use_quota=True,user_id='f0d4916eb93c4b3ebbbd2af4b0cdacc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:9f8127e3-8945-4981-8c0f-0796caa6a80c. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] detach volume v_9f8127e3-8945-4981-8c0f-0796caa6a80c from target iqn.2010-10.org.openstack:9f8127e3-8945-4981-8c0f-0796caa6a80c {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f8127e3-8945-4981-8c0f-0796caa6a80c/luns/v_9f8127e3-8945-4981-8c0f-0796caa6a80c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f8127e3-8945-4981-8c0f-0796caa6a80c/luns/v_9f8127e3-8945-4981-8c0f-0796caa6a80c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9f8127e3-8945-4981-8c0f-0796caa6a80c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f8127e3-8945-4981-8c0f-0796caa6a80c/luns/v_9f8127e3-8945-4981-8c0f-0796caa6a80c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f8127e3-8945-4981-8c0f-0796caa6a80c/luns/v_9f8127e3-8945-4981-8c0f-0796caa6a80c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] failed to remove resource iqn.2010-10.org.openstack:9f8127e3-8945-4981-8c0f-0796caa6a80c because of JDSS resource v_9f8127e3-8945-4981-8c0f-0796caa6a80c DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] delete target: iqn.2010-10.org.openstack:9f8127e3-8945-4981-8c0f-0796caa6a80c {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] delete target iqn.2010-10.org.openstack:9f8127e3-8945-4981-8c0f-0796caa6a80c {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f8127e3-8945-4981-8c0f-0796caa6a80c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f8127e3-8945-4981-8c0f-0796caa6a80c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9f8127e3-8945-4981-8c0f-0796caa6a80c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f8127e3-8945-4981-8c0f-0796caa6a80c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9f8127e3-8945-4981-8c0f-0796caa6a80c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] failed to remove resource iqn.2010-10.org.openstack:9f8127e3-8945-4981-8c0f-0796caa6a80c because of JDSS resource iqn.2010-10.org.openstack:9f8127e3-8945-4981-8c0f-0796caa6a80c DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] deleating volume v_9f8127e3-8945-4981-8c0f-0796caa6a80c {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] get snapshots for volume v_9f8127e3-8945-4981-8c0f-0796caa6a80c {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f8127e3-8945-4981-8c0f-0796caa6a80c/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f8127e3-8945-4981-8c0f-0796caa6a80c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114266021888', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:03:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:03:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f8127e3-8945-4981-8c0f-0796caa6a80c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] get volume v_9f8127e3-8945-4981-8c0f-0796caa6a80c info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:03:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f8127e3-8945-4981-8c0f-0796caa6a80c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f8127e3-8945-4981-8c0f-0796caa6a80c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9f8127e3-8945-4981-8c0f-0796caa6a80c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442791', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112876', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '369504857486980750', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd804acc6f27e5abd', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114266021888', 'san:volume_id': 'd804acc6f27e5abdebe39a1852524f309ea2088b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84989', 'name': 'v_9f8127e3-8945-4981-8c0f-0796caa6a80c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f8127e3-8945-4981-8c0f-0796caa6a80c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] delete volume:v_9f8127e3-8945-4981-8c0f-0796caa6a80c recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:03:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f8127e3-8945-4981-8c0f-0796caa6a80c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f8127e3-8945-4981-8c0f-0796caa6a80c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9f8127e3-8945-4981-8c0f-0796caa6a80c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] volume v_9f8127e3-8945-4981-8c0f-0796caa6a80c deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:03:06 user cinder-volume[73403]: DEBUG cinder.quota [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Created reservations ['4b071ed1-6a71-466f-ae8c-de4594bbd90b', 'd8533ac6-c653-413e-b35e-dd6b50741d1c', 'c21572c6-a94a-4050-bb5e-399b5554cff1', '342e5882-4f93-49fc-b038-b831f241d19e'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:03:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:03:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:03:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Geting {'code': 200, 'error': None, 'data': {'available': '114266103808', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:03:06 user cinder-volume[73403]: DEBUG cinder.manager [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:03:06 user cinder-volume[73403]: INFO cinder.volume.manager [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Deleted volume successfully. Apr 14 03:03:06 user cinder-volume[73403]: DEBUG cinder.coordination [None req-64833c64-50d0-40d3-b5a1-81bf20826a35 tempest-VolumesAdminNegativeTest-1232189050 None] Lock "cinder-9f8127e3-8945-4981-8c0f-0796caa6a80c-delete_volume" released by "delete_volume" :: held 3.138s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:03:22 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:03:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Flow 'volume_create_manager' (ee07f79b-db17-4209-a0c7-c3f36b93e814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:03:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537fbe43-47a7-413e-bc09-c11fb9f44dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:03:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537fbe43-47a7-413e-bc09-c11fb9f44dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1934265615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b79b29ca-aed8-4f63-87e4-2088158dca75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f021342634dd4f16bf2720533070154c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:03:22Z,use_quota=True,user_id='0dbce21e767a4a61b9213e38523d247e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:03:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356d25aa-e8f7-47e3-a624-b7c8e7b93881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:03:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356d25aa-e8f7-47e3-a624-b7c8e7b93881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:03:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa683db-9e15-4e55-9bd3-3af3a2f5e47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:03:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa683db-9e15-4e55-9bd3-3af3a2f5e47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b79b29ca-aed8-4f63-87e4-2088158dca75', 'volume_name': 'volume-b79b29ca-aed8-4f63-87e4-2088158dca75', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:03:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e168cda6-9214-4675-a112-f8526edfc190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:03:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e168cda6-9214-4675-a112-f8526edfc190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:03:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523f216e-ccec-4b9c-963c-011405c2be49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:03:22 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Volume b79b29ca-aed8-4f63-87e4-2088158dca75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b79b29ca-aed8-4f63-87e4-2088158dca75', 'volume_size': 1} Apr 14 03:03:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] creating volume v_b79b29ca-aed8-4f63-87e4-2088158dca75. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:03:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] create volume {'name': 'v_b79b29ca-aed8-4f63-87e4-2088158dca75', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:03:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:22 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=24,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b79b29ca-aed8-4f63-87e4-2088158dca75', 'is_clone': False, 'name': 'v_b79b29ca-aed8-4f63-87e4-2088158dca75'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523f216e-ccec-4b9c-963c-011405c2be49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b79b29ca-aed8-4f63-87e4-2088158dca75', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:03:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fde8c6-a53d-49e9-bc5e-8c83a2f1fb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:03:23 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Volume volume-b79b29ca-aed8-4f63-87e4-2088158dca75 (b79b29ca-aed8-4f63-87e4-2088158dca75): created successfully Apr 14 03:03:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fde8c6-a53d-49e9-bc5e-8c83a2f1fb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:03:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Flow 'volume_create_manager' (ee07f79b-db17-4209-a0c7-c3f36b93e814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:03:23 user cinder-volume[73403]: INFO cinder.volume.manager [None req-13eb9351-6d96-4e65-b82e-ebe9cffac6d4 tempest-ServersNegativeTestJSON-675126189 None] Created volume successfully. Apr 14 03:03:40 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=18,cinder:INSERT=2,cinder:UPDATE=14 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b0001b2f-4592-42ca-a37e-95eb3b6040bb req-8a848a55-e376-4dd3-97bc-8ab1417a0330 tempest-AttachVolumeTestJSON-975876676 None] terminate connection for d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:03:40 user cinder-volume[73403]: INFO cinder.volume.manager [req-b0001b2f-4592-42ca-a37e-95eb3b6040bb req-8a848a55-e376-4dd3-97bc-8ab1417a0330 tempest-AttachVolumeTestJSON-975876676 None] Terminate volume connection completed successfully. Apr 14 03:03:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-b0001b2f-4592-42ca-a37e-95eb3b6040bb req-8a848a55-e376-4dd3-97bc-8ab1417a0330 tempest-AttachVolumeTestJSON-975876676 None] Deleting attachment 74d9f89b-3416-45c5-8af8-870134e07548. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:03:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b0001b2f-4592-42ca-a37e-95eb3b6040bb req-8a848a55-e376-4dd3-97bc-8ab1417a0330 tempest-AttachVolumeTestJSON-975876676 None] remove_export for volume: d1ac2d2b-c18f-4958-a86e-fa298a15c9b8. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:03:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b0001b2f-4592-42ca-a37e-95eb3b6040bb req-8a848a55-e376-4dd3-97bc-8ab1417a0330 tempest-AttachVolumeTestJSON-975876676 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:03:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b0001b2f-4592-42ca-a37e-95eb3b6040bb req-8a848a55-e376-4dd3-97bc-8ab1417a0330 tempest-AttachVolumeTestJSON-975876676 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-197093691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d1ac2d2b-c18f-4958-a86e-fa298a15c9b8,launched_at=2023-04-14T02:59:48Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='130665008cf648cf87467ae2777a9170',provider_auth='CHAP mpkibDRE 4JupsCRjwvPz9n',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:59:47Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:03:40Z,use_quota=True,user_id='d6d78d4991b5493e8893034e91ed407b',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:03:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b0001b2f-4592-42ca-a37e-95eb3b6040bb req-8a848a55-e376-4dd3-97bc-8ab1417a0330 tempest-AttachVolumeTestJSON-975876676 None] detach volume v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 from target iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:03:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b0001b2f-4592-42ca-a37e-95eb3b6040bb req-8a848a55-e376-4dd3-97bc-8ab1417a0330 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8/luns/v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b0001b2f-4592-42ca-a37e-95eb3b6040bb req-8a848a55-e376-4dd3-97bc-8ab1417a0330 tempest-AttachVolumeTestJSON-975876676 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8/luns/v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b0001b2f-4592-42ca-a37e-95eb3b6040bb req-8a848a55-e376-4dd3-97bc-8ab1417a0330 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8/luns/v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b0001b2f-4592-42ca-a37e-95eb3b6040bb req-8a848a55-e376-4dd3-97bc-8ab1417a0330 tempest-AttachVolumeTestJSON-975876676 None] delete target: iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:03:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b0001b2f-4592-42ca-a37e-95eb3b6040bb req-8a848a55-e376-4dd3-97bc-8ab1417a0330 tempest-AttachVolumeTestJSON-975876676 None] delete target iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:03:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b0001b2f-4592-42ca-a37e-95eb3b6040bb req-8a848a55-e376-4dd3-97bc-8ab1417a0330 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b0001b2f-4592-42ca-a37e-95eb3b6040bb req-8a848a55-e376-4dd3-97bc-8ab1417a0330 tempest-AttachVolumeTestJSON-975876676 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b0001b2f-4592-42ca-a37e-95eb3b6040bb req-8a848a55-e376-4dd3-97bc-8ab1417a0330 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b0001b2f-4592-42ca-a37e-95eb3b6040bb req-8a848a55-e376-4dd3-97bc-8ab1417a0330 tempest-AttachVolumeTestJSON-975876676 None] target iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca8f998b-c574-4c82-9b90-52772525f81c req-4f40d24a-e8e2-4f8a-bd83-b40be07599c6 tempest-TaggedBootDevicesTest-226254012 None] terminate connection for 453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:03:43 user cinder-volume[73403]: INFO cinder.volume.manager [req-ca8f998b-c574-4c82-9b90-52772525f81c req-4f40d24a-e8e2-4f8a-bd83-b40be07599c6 tempest-TaggedBootDevicesTest-226254012 None] Terminate volume connection completed successfully. Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-ca8f998b-c574-4c82-9b90-52772525f81c req-4f40d24a-e8e2-4f8a-bd83-b40be07599c6 tempest-TaggedBootDevicesTest-226254012 None] Deleting attachment 897df238-c72c-46c7-80f3-6844d072066a. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca8f998b-c574-4c82-9b90-52772525f81c req-4f40d24a-e8e2-4f8a-bd83-b40be07599c6 tempest-TaggedBootDevicesTest-226254012 None] remove_export for volume: 453b7855-8efd-41bd-806c-18ae2c03ac49. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca8f998b-c574-4c82-9b90-52772525f81c req-4f40d24a-e8e2-4f8a-bd83-b40be07599c6 tempest-TaggedBootDevicesTest-226254012 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca8f998b-c574-4c82-9b90-52772525f81c req-4f40d24a-e8e2-4f8a-bd83-b40be07599c6 tempest-TaggedBootDevicesTest-226254012 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1976350653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=453b7855-8efd-41bd-806c-18ae2c03ac49,launched_at=2023-04-14T03:01:25Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='de2d10e0d7e7477484e4204841a3980c',provider_auth='CHAP KgfYmwnl lGPDjv7JQgCzZO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:01:23Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:01:54Z,use_quota=True,user_id='c3c342144e51496190e32329225ddd2b',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ca8f998b-c574-4c82-9b90-52772525f81c req-4f40d24a-e8e2-4f8a-bd83-b40be07599c6 tempest-TaggedBootDevicesTest-226254012 None] detach volume v_453b7855-8efd-41bd-806c-18ae2c03ac49 from target iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca8f998b-c574-4c82-9b90-52772525f81c req-4f40d24a-e8e2-4f8a-bd83-b40be07599c6 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49/luns/v_453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca8f998b-c574-4c82-9b90-52772525f81c req-4f40d24a-e8e2-4f8a-bd83-b40be07599c6 tempest-TaggedBootDevicesTest-226254012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49/luns/v_453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca8f998b-c574-4c82-9b90-52772525f81c req-4f40d24a-e8e2-4f8a-bd83-b40be07599c6 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49/luns/v_453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca8f998b-c574-4c82-9b90-52772525f81c req-4f40d24a-e8e2-4f8a-bd83-b40be07599c6 tempest-TaggedBootDevicesTest-226254012 None] delete target: iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ca8f998b-c574-4c82-9b90-52772525f81c req-4f40d24a-e8e2-4f8a-bd83-b40be07599c6 tempest-TaggedBootDevicesTest-226254012 None] delete target iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca8f998b-c574-4c82-9b90-52772525f81c req-4f40d24a-e8e2-4f8a-bd83-b40be07599c6 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca8f998b-c574-4c82-9b90-52772525f81c req-4f40d24a-e8e2-4f8a-bd83-b40be07599c6 tempest-TaggedBootDevicesTest-226254012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca8f998b-c574-4c82-9b90-52772525f81c req-4f40d24a-e8e2-4f8a-bd83-b40be07599c6 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ca8f998b-c574-4c82-9b90-52772525f81c req-4f40d24a-e8e2-4f8a-bd83-b40be07599c6 tempest-TaggedBootDevicesTest-226254012 None] target iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca8f998b-c574-4c82-9b90-52772525f81c req-c947a358-adcb-4e83-b95c-f3cea51d72cb tempest-TaggedBootDevicesTest-226254012 None] terminate connection for ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:03:43 user cinder-volume[73403]: INFO cinder.volume.manager [req-ca8f998b-c574-4c82-9b90-52772525f81c req-c947a358-adcb-4e83-b95c-f3cea51d72cb tempest-TaggedBootDevicesTest-226254012 None] Terminate volume connection completed successfully. Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-ca8f998b-c574-4c82-9b90-52772525f81c req-c947a358-adcb-4e83-b95c-f3cea51d72cb tempest-TaggedBootDevicesTest-226254012 None] Deleting attachment 7bc346aa-0798-431e-9e3c-58701616304e. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca8f998b-c574-4c82-9b90-52772525f81c req-c947a358-adcb-4e83-b95c-f3cea51d72cb tempest-TaggedBootDevicesTest-226254012 None] remove_export for volume: ba0a016e-f7ab-4aac-8fb3-ecf199678570. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca8f998b-c574-4c82-9b90-52772525f81c req-c947a358-adcb-4e83-b95c-f3cea51d72cb tempest-TaggedBootDevicesTest-226254012 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca8f998b-c574-4c82-9b90-52772525f81c req-c947a358-adcb-4e83-b95c-f3cea51d72cb tempest-TaggedBootDevicesTest-226254012 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-844414107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ba0a016e-f7ab-4aac-8fb3-ecf199678570,launched_at=2023-04-14T03:01:22Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='de2d10e0d7e7477484e4204841a3980c',provider_auth='CHAP VlDJEXwv CyvxAZ91UOH8F2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:01:20Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:01:49Z,use_quota=True,user_id='c3c342144e51496190e32329225ddd2b',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ca8f998b-c574-4c82-9b90-52772525f81c req-c947a358-adcb-4e83-b95c-f3cea51d72cb tempest-TaggedBootDevicesTest-226254012 None] detach volume v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 from target iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca8f998b-c574-4c82-9b90-52772525f81c req-c947a358-adcb-4e83-b95c-f3cea51d72cb tempest-TaggedBootDevicesTest-226254012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570/luns/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca8f998b-c574-4c82-9b90-52772525f81c req-c947a358-adcb-4e83-b95c-f3cea51d72cb tempest-TaggedBootDevicesTest-226254012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570/luns/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca8f998b-c574-4c82-9b90-52772525f81c req-c947a358-adcb-4e83-b95c-f3cea51d72cb tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570/luns/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca8f998b-c574-4c82-9b90-52772525f81c req-c947a358-adcb-4e83-b95c-f3cea51d72cb tempest-TaggedBootDevicesTest-226254012 None] delete target: iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:03:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ca8f998b-c574-4c82-9b90-52772525f81c req-c947a358-adcb-4e83-b95c-f3cea51d72cb tempest-TaggedBootDevicesTest-226254012 None] delete target iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:03:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca8f998b-c574-4c82-9b90-52772525f81c req-c947a358-adcb-4e83-b95c-f3cea51d72cb tempest-TaggedBootDevicesTest-226254012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca8f998b-c574-4c82-9b90-52772525f81c req-c947a358-adcb-4e83-b95c-f3cea51d72cb tempest-TaggedBootDevicesTest-226254012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca8f998b-c574-4c82-9b90-52772525f81c req-c947a358-adcb-4e83-b95c-f3cea51d72cb tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ca8f998b-c574-4c82-9b90-52772525f81c req-c947a358-adcb-4e83-b95c-f3cea51d72cb tempest-TaggedBootDevicesTest-226254012 None] target iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:03:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca8f998b-c574-4c82-9b90-52772525f81c req-1e333157-25e8-4901-956a-c4766077d2d8 tempest-TaggedBootDevicesTest-226254012 None] terminate connection for c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:03:44 user cinder-volume[73403]: INFO cinder.volume.manager [req-ca8f998b-c574-4c82-9b90-52772525f81c req-1e333157-25e8-4901-956a-c4766077d2d8 tempest-TaggedBootDevicesTest-226254012 None] Terminate volume connection completed successfully. Apr 14 03:03:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-ca8f998b-c574-4c82-9b90-52772525f81c req-1e333157-25e8-4901-956a-c4766077d2d8 tempest-TaggedBootDevicesTest-226254012 None] Deleting attachment d1db064f-367e-4d97-a3dc-7007a652c17b. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:03:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca8f998b-c574-4c82-9b90-52772525f81c req-1e333157-25e8-4901-956a-c4766077d2d8 tempest-TaggedBootDevicesTest-226254012 None] remove_export for volume: c11ac81e-755b-4855-85b5-259c815fef2c. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:03:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca8f998b-c574-4c82-9b90-52772525f81c req-1e333157-25e8-4901-956a-c4766077d2d8 tempest-TaggedBootDevicesTest-226254012 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:03:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca8f998b-c574-4c82-9b90-52772525f81c req-1e333157-25e8-4901-956a-c4766077d2d8 tempest-TaggedBootDevicesTest-226254012 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1814896836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c11ac81e-755b-4855-85b5-259c815fef2c,launched_at=2023-04-14T03:01:27Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='de2d10e0d7e7477484e4204841a3980c',provider_auth='CHAP pGxcVBXE fK6r5Pj0XSxIAO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:01:26Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:02:00Z,use_quota=True,user_id='c3c342144e51496190e32329225ddd2b',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:03:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ca8f998b-c574-4c82-9b90-52772525f81c req-1e333157-25e8-4901-956a-c4766077d2d8 tempest-TaggedBootDevicesTest-226254012 None] detach volume v_c11ac81e-755b-4855-85b5-259c815fef2c from target iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:03:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca8f998b-c574-4c82-9b90-52772525f81c req-1e333157-25e8-4901-956a-c4766077d2d8 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c/luns/v_c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca8f998b-c574-4c82-9b90-52772525f81c req-1e333157-25e8-4901-956a-c4766077d2d8 tempest-TaggedBootDevicesTest-226254012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c/luns/v_c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca8f998b-c574-4c82-9b90-52772525f81c req-1e333157-25e8-4901-956a-c4766077d2d8 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c/luns/v_c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ca8f998b-c574-4c82-9b90-52772525f81c req-1e333157-25e8-4901-956a-c4766077d2d8 tempest-TaggedBootDevicesTest-226254012 None] delete target: iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:03:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ca8f998b-c574-4c82-9b90-52772525f81c req-1e333157-25e8-4901-956a-c4766077d2d8 tempest-TaggedBootDevicesTest-226254012 None] delete target iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:03:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca8f998b-c574-4c82-9b90-52772525f81c req-1e333157-25e8-4901-956a-c4766077d2d8 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca8f998b-c574-4c82-9b90-52772525f81c req-1e333157-25e8-4901-956a-c4766077d2d8 tempest-TaggedBootDevicesTest-226254012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ca8f998b-c574-4c82-9b90-52772525f81c req-1e333157-25e8-4901-956a-c4766077d2d8 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ca8f998b-c574-4c82-9b90-52772525f81c req-1e333157-25e8-4901-956a-c4766077d2d8 tempest-TaggedBootDevicesTest-226254012 None] target iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:03:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] create export for volume: 0032d61d-2851-4bde-b7cd-42043f3b1a7f. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:03:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] ensure volume 0032d61d-2851-4bde-b7cd-42043f3b1a7f assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:03:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] check if targe iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:03:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] create target and attach volume 0032d61d-2851-4bde-b7cd-42043f3b1a7f to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:03:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] create target iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:03:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] atach volume v_0032d61d-2851-4bde-b7cd-42043f3b1a7f to target iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:03:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6132653533633730', 'lun': 0, 'mode': 'wt', 'name': 'v_0032d61d-2851-4bde-b7cd-42043f3b1a7f', 'prod_id': 'Storage', 'scsi_id': 'a2e53c70c7f5fd28'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] add credentails to target iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:03:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] Geting {'code': 201, 'error': None, 'data': {'name': 'DtCpadIK'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] initialize_connection for 0032d61d-2851-4bde-b7cd-42043f3b1a7f 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:03:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtCpadIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'e2b6388f-42f4-4160-ba5f-2306922c9f5a'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:03:52 user cinder-volume[73403]: INFO cinder.volume.manager [req-b67cc212-2026-4f04-8ae8-c311818e9eb9 req-3dfe392c-da83-45e1-b9ba-458188bac5f5 tempest-TestVolumeSwap-1328008515 None] attachment_update completed successfully. Apr 14 03:03:55 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=28,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:03:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] create export for volume: 80d66b06-08ad-4e2d-b0b7-5906492cd660. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:03:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] ensure volume 80d66b06-08ad-4e2d-b0b7-5906492cd660 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:03:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] check if targe iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:03:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] create target and attach volume 80d66b06-08ad-4e2d-b0b7-5906492cd660 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:03:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] create target iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:03:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Acquiring lock "cinder-c85af65b-ba3d-4e6f-9d4b-0da7c73c091b-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Lock "cinder-c85af65b-ba3d-4e6f-9d4b-0da7c73c091b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] remove_export for volume: c85af65b-ba3d-4e6f-9d4b-0da7c73c091b. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2044133642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c85af65b-ba3d-4e6f-9d4b-0da7c73c091b,launched_at=2023-04-14T03:00:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94a1eb61159b43228db0d529a5be816d',provider_auth='CHAP kXUbzEVK KDoNCAxt0PXGs8',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:00:09Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:03:57Z,updated_at=2023-04-14T03:03:57Z,use_quota=True,user_id='f0d4916eb93c4b3ebbbd2af4b0cdacc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] detach volume v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b from target iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b/luns/v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b/luns/v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b/luns/v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b/luns/v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] failed to remove resource iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b because of JDSS resource v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] delete target: iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] delete target iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] failed to remove resource iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b because of JDSS resource iqn.2010-10.org.openstack:c85af65b-ba3d-4e6f-9d4b-0da7c73c091b DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] deleating volume v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] get snapshots for volume v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] get volume v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442618', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112744', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1761517410636304660', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'beb70836820f097f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114266013696', 'san:volume_id': 'beb70836820f097fe01133bc71ffb3d04e5d4135', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84446', 'name': 'v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] delete volume:v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] atach volume v_80d66b06-08ad-4e2d-b0b7-5906492cd660 to target iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:03:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3833346630373930', 'lun': 0, 'mode': 'wt', 'name': 'v_80d66b06-08ad-4e2d-b0b7-5906492cd660', 'prod_id': 'Storage', 'scsi_id': '834f0790455c8353'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] add credentails to target iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:03:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:03:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] Geting {'code': 201, 'error': None, 'data': {'name': 'FGovYJtj'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] initialize_connection for 80d66b06-08ad-4e2d-b0b7-5906492cd660 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:03:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGovYJtj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'ca0a896b-9c6c-43b7-82bc-710261959b12'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:03:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:03:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] volume v_c85af65b-ba3d-4e6f-9d4b-0da7c73c091b deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:03:59 user cinder-volume[73403]: INFO cinder.volume.manager [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-80d32562-c141-4a84-8732-afd57c1b4d19 tempest-TestVolumeSwap-1976683534 None] attachment_update completed successfully. Apr 14 03:03:59 user cinder-volume[73403]: DEBUG cinder.quota [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Created reservations ['3e695890-26c4-4483-95c8-2cfe637cc040', 'eb4c1df4-4565-4f73-8781-3aabd8f772c9', '3509ba1b-fac3-47a4-a1e2-1758fa9d055c', '10ade456-3209-4582-ab51-88cd82925113'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:03:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:03:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:03:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:03:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Geting {'code': 200, 'error': None, 'data': {'available': '114266120192', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:04:00 user cinder-volume[73403]: DEBUG cinder.manager [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:04:00 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Deleted volume successfully. Apr 14 03:04:00 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a223044d-ffb4-4d3b-bdbe-c575ce09ce07 tempest-VolumesAdminNegativeTest-1232189050 None] Lock "cinder-c85af65b-ba3d-4e6f-9d4b-0da7c73c091b-delete_volume" released by "delete_volume" :: held 3.268s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:04:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:04:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:04:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:04:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114266107904', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:04:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:04:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-74f71b76-7584-4121-ae00-8d18e99db83e tempest-TestVolumeSwap-1976683534 None] terminate connection for 0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:04:06 user cinder-volume[73403]: INFO cinder.volume.manager [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-74f71b76-7584-4121-ae00-8d18e99db83e tempest-TestVolumeSwap-1976683534 None] Terminate volume connection completed successfully. Apr 14 03:04:06 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-74f71b76-7584-4121-ae00-8d18e99db83e tempest-TestVolumeSwap-1976683534 None] Deleting attachment e2b6388f-42f4-4160-ba5f-2306922c9f5a. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:04:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-74f71b76-7584-4121-ae00-8d18e99db83e tempest-TestVolumeSwap-1976683534 None] remove_export for volume: 0032d61d-2851-4bde-b7cd-42043f3b1a7f. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:04:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-74f71b76-7584-4121-ae00-8d18e99db83e tempest-TestVolumeSwap-1976683534 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:04:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-74f71b76-7584-4121-ae00-8d18e99db83e tempest-TestVolumeSwap-1976683534 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1687729802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0032d61d-2851-4bde-b7cd-42043f3b1a7f,launched_at=2023-04-14T03:01:50Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='f987064bf0ed4a2fa8714064fe8b43c8',provider_auth='CHAP DtCpadIK eUsmbH1Qj5ZP0o',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:01:49Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:03:55Z,use_quota=True,user_id='f089c5c093754f8082181a8fc1c002f4',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:04:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-74f71b76-7584-4121-ae00-8d18e99db83e tempest-TestVolumeSwap-1976683534 None] detach volume v_0032d61d-2851-4bde-b7cd-42043f3b1a7f from target iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:04:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-74f71b76-7584-4121-ae00-8d18e99db83e tempest-TestVolumeSwap-1976683534 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/luns/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-74f71b76-7584-4121-ae00-8d18e99db83e tempest-TestVolumeSwap-1976683534 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/luns/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-74f71b76-7584-4121-ae00-8d18e99db83e tempest-TestVolumeSwap-1976683534 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/luns/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-74f71b76-7584-4121-ae00-8d18e99db83e tempest-TestVolumeSwap-1976683534 None] delete target: iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:04:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-74f71b76-7584-4121-ae00-8d18e99db83e tempest-TestVolumeSwap-1976683534 None] delete target iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:04:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-74f71b76-7584-4121-ae00-8d18e99db83e tempest-TestVolumeSwap-1976683534 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-74f71b76-7584-4121-ae00-8d18e99db83e tempest-TestVolumeSwap-1976683534 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-74f71b76-7584-4121-ae00-8d18e99db83e tempest-TestVolumeSwap-1976683534 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-88a3c668-9f74-4a4d-8655-a29086dfa3cd req-74f71b76-7584-4121-ae00-8d18e99db83e tempest-TestVolumeSwap-1976683534 None] target iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:04:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] create export for volume: 0032d61d-2851-4bde-b7cd-42043f3b1a7f. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:04:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] ensure volume 0032d61d-2851-4bde-b7cd-42043f3b1a7f assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:04:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] check if targe iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:04:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] create target and attach volume 0032d61d-2851-4bde-b7cd-42043f3b1a7f to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:04:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] create target iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:04:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] atach volume v_0032d61d-2851-4bde-b7cd-42043f3b1a7f to target iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:04:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6132653533633730', 'lun': 0, 'mode': 'wt', 'name': 'v_0032d61d-2851-4bde-b7cd-42043f3b1a7f', 'prod_id': 'Storage', 'scsi_id': 'a2e53c70c7f5fd28'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] add credentails to target iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:04:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] Geting {'code': 201, 'error': None, 'data': {'name': 'DtCpadIK'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:11 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=51,cinder:UPDATE=17,cinder:INSERT=1,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] initialize_connection for 0032d61d-2851-4bde-b7cd-42043f3b1a7f 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:04:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtCpadIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '5b96afaa-298b-4258-8065-e9ba3e31a4f4'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:04:11 user cinder-volume[73403]: INFO cinder.volume.manager [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-b446827d-ac82-4144-b70d-db3b081de77a tempest-TestVolumeSwap-1976683534 None] attachment_update completed successfully. Apr 14 03:04:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-99ca841f-9798-4395-a178-983a105ca59c tempest-TestVolumeSwap-1976683534 None] terminate connection for 80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:04:18 user cinder-volume[73403]: INFO cinder.volume.manager [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-99ca841f-9798-4395-a178-983a105ca59c tempest-TestVolumeSwap-1976683534 None] Terminate volume connection completed successfully. Apr 14 03:04:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-99ca841f-9798-4395-a178-983a105ca59c tempest-TestVolumeSwap-1976683534 None] Deleting attachment ca0a896b-9c6c-43b7-82bc-710261959b12. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:04:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-99ca841f-9798-4395-a178-983a105ca59c tempest-TestVolumeSwap-1976683534 None] remove_export for volume: 80d66b06-08ad-4e2d-b0b7-5906492cd660. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:04:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-99ca841f-9798-4395-a178-983a105ca59c tempest-TestVolumeSwap-1976683534 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:04:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-99ca841f-9798-4395-a178-983a105ca59c tempest-TestVolumeSwap-1976683534 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1171189618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=80d66b06-08ad-4e2d-b0b7-5906492cd660,launched_at=2023-04-14T03:01:52Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='f987064bf0ed4a2fa8714064fe8b43c8',provider_auth='CHAP FGovYJtj Gl8HmxdDhXEIVU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:01:51Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:04:07Z,use_quota=True,user_id='f089c5c093754f8082181a8fc1c002f4',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:04:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-99ca841f-9798-4395-a178-983a105ca59c tempest-TestVolumeSwap-1976683534 None] detach volume v_80d66b06-08ad-4e2d-b0b7-5906492cd660 from target iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:04:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-99ca841f-9798-4395-a178-983a105ca59c tempest-TestVolumeSwap-1976683534 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660/luns/v_80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-99ca841f-9798-4395-a178-983a105ca59c tempest-TestVolumeSwap-1976683534 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660/luns/v_80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-99ca841f-9798-4395-a178-983a105ca59c tempest-TestVolumeSwap-1976683534 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660/luns/v_80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-99ca841f-9798-4395-a178-983a105ca59c tempest-TestVolumeSwap-1976683534 None] delete target: iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:04:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-99ca841f-9798-4395-a178-983a105ca59c tempest-TestVolumeSwap-1976683534 None] delete target iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:04:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-99ca841f-9798-4395-a178-983a105ca59c tempest-TestVolumeSwap-1976683534 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-99ca841f-9798-4395-a178-983a105ca59c tempest-TestVolumeSwap-1976683534 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-99ca841f-9798-4395-a178-983a105ca59c tempest-TestVolumeSwap-1976683534 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-52fc5624-5b30-4fef-bd2d-fff64eca21ec req-99ca841f-9798-4395-a178-983a105ca59c tempest-TestVolumeSwap-1976683534 None] target iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:04:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0f0a80d-f60f-4875-96f0-6f7b68070488 req-4732564e-9163-46be-ad5e-a483e8cdf4f3 tempest-TestVolumeSwap-1328008515 None] terminate connection for 0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:04:20 user cinder-volume[73403]: INFO cinder.volume.manager [req-a0f0a80d-f60f-4875-96f0-6f7b68070488 req-4732564e-9163-46be-ad5e-a483e8cdf4f3 tempest-TestVolumeSwap-1328008515 None] Terminate volume connection completed successfully. Apr 14 03:04:20 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-a0f0a80d-f60f-4875-96f0-6f7b68070488 req-4732564e-9163-46be-ad5e-a483e8cdf4f3 tempest-TestVolumeSwap-1328008515 None] Deleting attachment 5b96afaa-298b-4258-8065-e9ba3e31a4f4. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:04:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0f0a80d-f60f-4875-96f0-6f7b68070488 req-4732564e-9163-46be-ad5e-a483e8cdf4f3 tempest-TestVolumeSwap-1328008515 None] remove_export for volume: 0032d61d-2851-4bde-b7cd-42043f3b1a7f. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:04:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0f0a80d-f60f-4875-96f0-6f7b68070488 req-4732564e-9163-46be-ad5e-a483e8cdf4f3 tempest-TestVolumeSwap-1328008515 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:04:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0f0a80d-f60f-4875-96f0-6f7b68070488 req-4732564e-9163-46be-ad5e-a483e8cdf4f3 tempest-TestVolumeSwap-1328008515 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1687729802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0032d61d-2851-4bde-b7cd-42043f3b1a7f,launched_at=2023-04-14T03:01:50Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='f987064bf0ed4a2fa8714064fe8b43c8',provider_auth='CHAP DtCpadIK eUsmbH1Qj5ZP0o',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:01:49Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:04:20Z,use_quota=True,user_id='f089c5c093754f8082181a8fc1c002f4',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:04:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a0f0a80d-f60f-4875-96f0-6f7b68070488 req-4732564e-9163-46be-ad5e-a483e8cdf4f3 tempest-TestVolumeSwap-1328008515 None] detach volume v_0032d61d-2851-4bde-b7cd-42043f3b1a7f from target iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:04:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0f0a80d-f60f-4875-96f0-6f7b68070488 req-4732564e-9163-46be-ad5e-a483e8cdf4f3 tempest-TestVolumeSwap-1328008515 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/luns/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0f0a80d-f60f-4875-96f0-6f7b68070488 req-4732564e-9163-46be-ad5e-a483e8cdf4f3 tempest-TestVolumeSwap-1328008515 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/luns/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 req-b6640f84-06e1-4232-b52f-22d56ce83013 tempest-TestVolumeBootPattern-910285030 None] create snapshot f78b3968-f436-44d2-8fb3-4f3d899eeed5 for volume 37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:04:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 req-b6640f84-06e1-4232-b52f-22d56ce83013 tempest-TestVolumeBootPattern-910285030 None] cloning v_37bd0d93-b922-426c-8986-d86e886da69e to s_f78b3968-f436-44d2-8fb3-4f3d899eeed5 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:04:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 req-b6640f84-06e1-4232-b52f-22d56ce83013 tempest-TestVolumeBootPattern-910285030 None] create snapshot s_f78b3968-f436-44d2-8fb3-4f3d899eeed5 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:04:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 req-b6640f84-06e1-4232-b52f-22d56ce83013 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bd0d93-b922-426c-8986-d86e886da69e/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 req-b6640f84-06e1-4232-b52f-22d56ce83013 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bd0d93-b922-426c-8986-d86e886da69e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0f0a80d-f60f-4875-96f0-6f7b68070488 req-4732564e-9163-46be-ad5e-a483e8cdf4f3 tempest-TestVolumeSwap-1328008515 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/luns/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0f0a80d-f60f-4875-96f0-6f7b68070488 req-4732564e-9163-46be-ad5e-a483e8cdf4f3 tempest-TestVolumeSwap-1328008515 None] delete target: iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:04:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a0f0a80d-f60f-4875-96f0-6f7b68070488 req-4732564e-9163-46be-ad5e-a483e8cdf4f3 tempest-TestVolumeSwap-1328008515 None] delete target iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:04:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0f0a80d-f60f-4875-96f0-6f7b68070488 req-4732564e-9163-46be-ad5e-a483e8cdf4f3 tempest-TestVolumeSwap-1328008515 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0f0a80d-f60f-4875-96f0-6f7b68070488 req-4732564e-9163-46be-ad5e-a483e8cdf4f3 tempest-TestVolumeSwap-1328008515 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0f0a80d-f60f-4875-96f0-6f7b68070488 req-4732564e-9163-46be-ad5e-a483e8cdf4f3 tempest-TestVolumeSwap-1328008515 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a0f0a80d-f60f-4875-96f0-6f7b68070488 req-4732564e-9163-46be-ad5e-a483e8cdf4f3 tempest-TestVolumeSwap-1328008515 None] target iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:04:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 req-b6640f84-06e1-4232-b52f-22d56ce83013 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_f78b3968-f436-44d2-8fb3-4f3d899eeed5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bd0d93-b922-426c-8986-d86e886da69e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 req-b6640f84-06e1-4232-b52f-22d56ce83013 tempest-TestVolumeBootPattern-910285030 None] create volume s_f78b3968-f436-44d2-8fb3-4f3d899eeed5 from snapshot s_f78b3968-f436-44d2-8fb3-4f3d899eeed5 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:04:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 req-b6640f84-06e1-4232-b52f-22d56ce83013 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bd0d93-b922-426c-8986-d86e886da69e/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 req-b6640f84-06e1-4232-b52f-22d56ce83013 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bd0d93-b922-426c-8986-d86e886da69e/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 req-b6640f84-06e1-4232-b52f-22d56ce83013 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_37bd0d93-b922-426c-8986-d86e886da69e@s_f78b3968-f436-44d2-8fb3-4f3d899eeed5', 'is_clone': True, 'full_name': 'Pool-0/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5', 'name': 's_f78b3968-f436-44d2-8fb3-4f3d899eeed5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bd0d93-b922-426c-8986-d86e886da69e/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 req-b6640f84-06e1-4232-b52f-22d56ce83013 tempest-TestVolumeBootPattern-910285030 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 req-b6640f84-06e1-4232-b52f-22d56ce83013 tempest-TestVolumeBootPattern-910285030 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 req-b6640f84-06e1-4232-b52f-22d56ce83013 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 req-b6640f84-06e1-4232-b52f-22d56ce83013 tempest-TestVolumeBootPattern-910285030 None] volume s_f78b3968-f436-44d2-8fb3-4f3d899eeed5 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:04:22 user cinder-volume[73403]: INFO cinder.volume.manager [req-d3f123f4-3e2f-421d-ae2e-ff0823bca622 req-b6640f84-06e1-4232-b52f-22d56ce83013 tempest-TestVolumeBootPattern-910285030 None] Create snapshot completed successfully Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Flow 'volume_create_manager' (57feb754-4f07-49b1-b062-2a79bc1654d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90924b33-002b-4b43-beb9-881b0ec9d5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90924b33-002b-4b43-beb9-881b0ec9d5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:04:25Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=423d87a6-a274-408c-ab7c-e91e4edfd963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2e49e8e92e416faebf55e3d4e0e087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f78b3968-f436-44d2-8fb3-4f3d899eeed5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:04:25Z,use_quota=True,user_id='60e11b7ab2914209b23bf7a53791da64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503ed43a-ed53-47ba-a54a-78654bb0e459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503ed43a-ed53-47ba-a54a-78654bb0e459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29dcb154-5dcd-4c0f-a815-09c28effd743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29dcb154-5dcd-4c0f-a815-09c28effd743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '423d87a6-a274-408c-ab7c-e91e4edfd963', 'volume_name': 'volume-423d87a6-a274-408c-ab7c-e91e4edfd963', 'volume_size': 1, 'snapshot_id': 'f78b3968-f436-44d2-8fb3-4f3d899eeed5'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87477226-4885-4c74-85de-1c2c445c7160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87477226-4885-4c74-85de-1c2c445c7160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f106082-5986-4af5-a1db-21693ccf8e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:04:25 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Volume 423d87a6-a274-408c-ab7c-e91e4edfd963: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-423d87a6-a274-408c-ab7c-e91e4edfd963', 'volume_size': 1, 'snapshot_id': 'f78b3968-f436-44d2-8fb3-4f3d899eeed5'} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=14,cinder:SELECT=51,cinder:INSERT=7,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] create volume 423d87a6-a274-408c-ab7c-e91e4edfd963 from snapshot f78b3968-f436-44d2-8fb3-4f3d899eeed5 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] cloning s_f78b3968-f436-44d2-8fb3-4f3d899eeed5 to v_423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] create snapshot v_423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] create export for volume: 95596aa7-5fd3-48b5-a091-0379a2e77fcc. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] ensure volume 95596aa7-5fd3-48b5-a091-0379a2e77fcc assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] check if targe iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] create target and attach volume 95596aa7-5fd3-48b5-a091-0379a2e77fcc to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] create target iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_423d87a6-a274-408c-ab7c-e91e4edfd963'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] create volume v_423d87a6-a274-408c-ab7c-e91e4edfd963 from snapshot v_423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:04:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5@v_423d87a6-a274-408c-ab7c-e91e4edfd963', 'is_clone': True, 'full_name': 'Pool-0/v_423d87a6-a274-408c-ab7c-e91e4edfd963', 'name': 'v_423d87a6-a274-408c-ab7c-e91e4edfd963'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] get volume v_423d87a6-a274-408c-ab7c-e91e4edfd963 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:04:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5@v_423d87a6-a274-408c-ab7c-e91e4edfd963', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_423d87a6-a274-408c-ab7c-e91e4edfd963', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442875', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26103808', 'sharesmb': None, 'createtxg': '112940', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '78883806518434343', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '66e744c9dad82263', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265964544', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85381', 'name': 'v_423d87a6-a274-408c-ab7c-e91e4edfd963', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '43593728', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:27 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Marking volume 423d87a6-a274-408c-ab7c-e91e4edfd963 as bootable. {{(pid=73403) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 03:04:27 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Copying metadata from snapshot f78b3968-f436-44d2-8fb3-4f3d899eeed5 to 423d87a6-a274-408c-ab7c-e91e4edfd963. {{(pid=73403) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Apr 14 03:04:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f106082-5986-4af5-a1db-21693ccf8e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-423d87a6-a274-408c-ab7c-e91e4edfd963', 'volume_size': 1, 'snapshot_id': 'f78b3968-f436-44d2-8fb3-4f3d899eeed5'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:04:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (877772d6-5b32-4810-ad34-9bc876f7b8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:04:27 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Volume volume-423d87a6-a274-408c-ab7c-e91e4edfd963 (423d87a6-a274-408c-ab7c-e91e4edfd963): created successfully Apr 14 03:04:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (877772d6-5b32-4810-ad34-9bc876f7b8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:04:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Flow 'volume_create_manager' (57feb754-4f07-49b1-b062-2a79bc1654d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:04:27 user cinder-volume[73403]: INFO cinder.volume.manager [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-756f3ff1-9900-42ed-8fd7-d125333f1b00 tempest-TestVolumeBootPattern-910285030 None] Created volume successfully. Apr 14 03:04:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] atach volume v_95596aa7-5fd3-48b5-a091-0379a2e77fcc to target iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:04:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3063386564356561', 'lun': 0, 'mode': 'wt', 'name': 'v_95596aa7-5fd3-48b5-a091-0379a2e77fcc', 'prod_id': 'Storage', 'scsi_id': '0c8ed5eabe5f71ef'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] add credentails to target iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:04:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] Geting {'code': 201, 'error': None, 'data': {'name': 'pTqrRZGK'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] initialize_connection for 95596aa7-5fd3-48b5-a091-0379a2e77fcc 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTqrRZGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '92d031d7-202c-4eeb-b2cb-9e7ee2abc59f'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:04:30 user cinder-volume[73403]: INFO cinder.volume.manager [req-bb713ff7-f256-4c55-8653-7c4b2b16a2ad req-25c30b3b-ea1f-4fb0-800e-543d1f9297c2 tempest-TestStampPattern-323884970 None] attachment_update completed successfully. Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.coordination [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Acquiring lock "cinder-c11ac81e-755b-4855-85b5-259c815fef2c-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.coordination [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Lock "cinder-c11ac81e-755b-4855-85b5-259c815fef2c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] remove_export for volume: c11ac81e-755b-4855-85b5-259c815fef2c. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1814896836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c11ac81e-755b-4855-85b5-259c815fef2c,launched_at=2023-04-14T03:01:27Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de2d10e0d7e7477484e4204841a3980c',provider_auth='CHAP pGxcVBXE fK6r5Pj0XSxIAO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:01:26Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:04:30Z,updated_at=2023-04-14T03:04:30Z,use_quota=True,user_id='c3c342144e51496190e32329225ddd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] detach volume v_c11ac81e-755b-4855-85b5-259c815fef2c from target iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c/luns/v_c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c/luns/v_c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c/luns/v_c11ac81e-755b-4855-85b5-259c815fef2c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c/luns/v_c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] failed to remove resource iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c because of JDSS resource v_c11ac81e-755b-4855-85b5-259c815fef2c DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] delete target: iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] delete target iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] failed to remove resource iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c because of JDSS resource iqn.2010-10.org.openstack:c11ac81e-755b-4855-85b5-259c815fef2c DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] deleating volume v_c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] get snapshots for volume v_c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c11ac81e-755b-4855-85b5-259c815fef2c/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c11ac81e-755b-4855-85b5-259c815fef2c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] create export for volume: 423d87a6-a274-408c-ab7c-e91e4edfd963. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] ensure volume 423d87a6-a274-408c-ab7c-e91e4edfd963 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] check if targe iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] create target and attach volume 423d87a6-a274-408c-ab7c-e91e4edfd963 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] create target iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c11ac81e-755b-4855-85b5-259c815fef2c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] get volume v_c11ac81e-755b-4855-85b5-259c815fef2c info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:04:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c11ac81e-755b-4855-85b5-259c815fef2c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442695', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112787', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2797766006872168193', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '065d62323d0516eb', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265952256', 'san:volume_id': '065d62323d0516eb77c22e4e0675a193c21e9355', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85065', 'name': 'v_c11ac81e-755b-4855-85b5-259c815fef2c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] delete volume:v_c11ac81e-755b-4855-85b5-259c815fef2c recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:04:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c11ac81e-755b-4855-85b5-259c815fef2c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] volume v_c11ac81e-755b-4855-85b5-259c815fef2c deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.quota [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Created reservations ['21fb6656-66d8-4b97-a9ca-3c4b28018e7e', '785a0a4e-86f2-48b9-a8df-adb754ad3db6', 'eb208e68-aab9-4059-b611-48d960bfa1f2', 'abd559b9-e408-4f67-b4a0-cbf12de61505'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.coordination [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Acquiring lock "cinder-453b7855-8efd-41bd-806c-18ae2c03ac49-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.coordination [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Lock "cinder-453b7855-8efd-41bd-806c-18ae2c03ac49-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] remove_export for volume: 453b7855-8efd-41bd-806c-18ae2c03ac49. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1976350653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=453b7855-8efd-41bd-806c-18ae2c03ac49,launched_at=2023-04-14T03:01:25Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de2d10e0d7e7477484e4204841a3980c',provider_auth='CHAP KgfYmwnl lGPDjv7JQgCzZO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:01:23Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:04:34Z,updated_at=2023-04-14T03:04:34Z,use_quota=True,user_id='c3c342144e51496190e32329225ddd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] detach volume v_453b7855-8efd-41bd-806c-18ae2c03ac49 from target iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49/luns/v_453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49/luns/v_453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49/luns/v_453b7855-8efd-41bd-806c-18ae2c03ac49'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49/luns/v_453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] failed to remove resource iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 because of JDSS resource v_453b7855-8efd-41bd-806c-18ae2c03ac49 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] delete target: iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] delete target iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] failed to remove resource iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 because of JDSS resource iqn.2010-10.org.openstack:453b7855-8efd-41bd-806c-18ae2c03ac49 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] deleating volume v_453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] get snapshots for volume v_453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_453b7855-8efd-41bd-806c-18ae2c03ac49/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_453b7855-8efd-41bd-806c-18ae2c03ac49/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] atach volume v_423d87a6-a274-408c-ab7c-e91e4edfd963 to target iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 200, 'error': None, 'data': {'available': '114266034176', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:04:34 user cinder-volume[73403]: DEBUG cinder.manager [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:04:34 user cinder-volume[73403]: INFO cinder.volume.manager [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Deleted volume successfully. Apr 14 03:04:34 user cinder-volume[73403]: DEBUG cinder.coordination [None req-430045d1-0b54-44e2-88cb-39045ef56b4c tempest-TaggedBootDevicesTest-226254012 None] Lock "cinder-c11ac81e-755b-4855-85b5-259c815fef2c-delete_volume" released by "delete_volume" :: held 3.609s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:04:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_453b7855-8efd-41bd-806c-18ae2c03ac49/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] get volume v_453b7855-8efd-41bd-806c-18ae2c03ac49 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:04:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_453b7855-8efd-41bd-806c-18ae2c03ac49', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442693', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112782', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7902848612785195898', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a546d7ba27d1bbb1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265931776', 'san:volume_id': 'a546d7ba27d1bbb17838e11637a46e2c93f07722', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84776', 'name': 'v_453b7855-8efd-41bd-806c-18ae2c03ac49', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] delete volume:v_453b7855-8efd-41bd-806c-18ae2c03ac49 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:04:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-70ceee7d-ed81-4567-995b-240deed754da req-d9c8225e-181b-43bb-b700-652fd2a4611d tempest-TestStampPattern-323884970 None] terminate connection for 95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:04:35 user cinder-volume[73403]: INFO cinder.volume.manager [req-70ceee7d-ed81-4567-995b-240deed754da req-d9c8225e-181b-43bb-b700-652fd2a4611d tempest-TestStampPattern-323884970 None] Terminate volume connection completed successfully. Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-70ceee7d-ed81-4567-995b-240deed754da req-d9c8225e-181b-43bb-b700-652fd2a4611d tempest-TestStampPattern-323884970 None] Deleting attachment 92d031d7-202c-4eeb-b2cb-9e7ee2abc59f. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-70ceee7d-ed81-4567-995b-240deed754da req-d9c8225e-181b-43bb-b700-652fd2a4611d tempest-TestStampPattern-323884970 None] remove_export for volume: 95596aa7-5fd3-48b5-a091-0379a2e77fcc. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-70ceee7d-ed81-4567-995b-240deed754da req-d9c8225e-181b-43bb-b700-652fd2a4611d tempest-TestStampPattern-323884970 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-70ceee7d-ed81-4567-995b-240deed754da req-d9c8225e-181b-43bb-b700-652fd2a4611d tempest-TestStampPattern-323884970 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-334653703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=95596aa7-5fd3-48b5-a091-0379a2e77fcc,launched_at=2023-04-14T03:02:31Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='6371b4c05df843da9b134e12994c1d7a',provider_auth='CHAP pTqrRZGK z1aos7EuI9tcb4',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:02:28Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=3c3ed512-4929-421f-b8d6-cf222944553d,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:04:34Z,use_quota=True,user_id='337e2d8118324215b5a0baa36a5895b0',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-70ceee7d-ed81-4567-995b-240deed754da req-d9c8225e-181b-43bb-b700-652fd2a4611d tempest-TestStampPattern-323884970 None] detach volume v_95596aa7-5fd3-48b5-a091-0379a2e77fcc from target iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-70ceee7d-ed81-4567-995b-240deed754da req-d9c8225e-181b-43bb-b700-652fd2a4611d tempest-TestStampPattern-323884970 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc/luns/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-70ceee7d-ed81-4567-995b-240deed754da req-d9c8225e-181b-43bb-b700-652fd2a4611d tempest-TestStampPattern-323884970 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc/luns/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-70ceee7d-ed81-4567-995b-240deed754da req-d9c8225e-181b-43bb-b700-652fd2a4611d tempest-TestStampPattern-323884970 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc/luns/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-70ceee7d-ed81-4567-995b-240deed754da req-d9c8225e-181b-43bb-b700-652fd2a4611d tempest-TestStampPattern-323884970 None] delete target: iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-70ceee7d-ed81-4567-995b-240deed754da req-d9c8225e-181b-43bb-b700-652fd2a4611d tempest-TestStampPattern-323884970 None] delete target iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-70ceee7d-ed81-4567-995b-240deed754da req-d9c8225e-181b-43bb-b700-652fd2a4611d tempest-TestStampPattern-323884970 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-70ceee7d-ed81-4567-995b-240deed754da req-d9c8225e-181b-43bb-b700-652fd2a4611d tempest-TestStampPattern-323884970 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3636653734346339', 'lun': 0, 'mode': 'wt', 'name': 'v_423d87a6-a274-408c-ab7c-e91e4edfd963', 'prod_id': 'Storage', 'scsi_id': '66e744c9dad82263'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] add credentails to target iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': {'name': 'ImLoQRXC'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] initialize_connection for 423d87a6-a274-408c-ab7c-e91e4edfd963 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ImLoQRXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '45b15196-b557-451c-9c76-a4a817032cbc'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=73,cinder:UPDATE=16,cinder:INSERT=9,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:35 user cinder-volume[73403]: INFO cinder.volume.manager [req-46cea914-cdf0-4144-b3d4-6fd25dd1a7f7 req-50477991-76c0-42d4-816b-5f4f099ef625 tempest-TestVolumeBootPattern-910285030 None] attachment_update completed successfully. Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-70ceee7d-ed81-4567-995b-240deed754da req-d9c8225e-181b-43bb-b700-652fd2a4611d tempest-TestStampPattern-323884970 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-70ceee7d-ed81-4567-995b-240deed754da req-d9c8225e-181b-43bb-b700-652fd2a4611d tempest-TestStampPattern-323884970 None] target iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:04:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_453b7855-8efd-41bd-806c-18ae2c03ac49 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] volume v_453b7855-8efd-41bd-806c-18ae2c03ac49 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:04:36 user cinder-volume[73403]: DEBUG cinder.quota [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Created reservations ['f6ab5dd4-194b-4e6b-bed6-3eb6db5d2fe3', '45fd6742-986e-48bb-adec-4865080a6292', '2305b6e8-e18e-40f3-be9e-4d0b3fd43e2e', '344d011f-a5b5-49b2-8a74-ce7b6730bec3'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:04:36 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=58,cinder:INSERT=18,cinder:UPDATE=24 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:04:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:04:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:04:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.coordination [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Acquiring lock "cinder-ba0a016e-f7ab-4aac-8fb3-ecf199678570-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.coordination [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Lock "cinder-ba0a016e-f7ab-4aac-8fb3-ecf199678570-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] remove_export for volume: ba0a016e-f7ab-4aac-8fb3-ecf199678570. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-844414107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ba0a016e-f7ab-4aac-8fb3-ecf199678570,launched_at=2023-04-14T03:01:22Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de2d10e0d7e7477484e4204841a3980c',provider_auth='CHAP VlDJEXwv CyvxAZ91UOH8F2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:01:20Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:04:37Z,updated_at=2023-04-14T03:04:37Z,use_quota=True,user_id='c3c342144e51496190e32329225ddd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] detach volume v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 from target iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570/luns/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570/luns/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570/luns/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570/luns/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] failed to remove resource iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 because of JDSS resource v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] delete target: iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] delete target iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] failed to remove resource iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 because of JDSS resource iqn.2010-10.org.openstack:ba0a016e-f7ab-4aac-8fb3-ecf199678570 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] deleating volume v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] get snapshots for volume v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 200, 'error': None, 'data': {'available': '114265989120', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.manager [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:04:37 user cinder-volume[73403]: INFO cinder.volume.manager [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Deleted volume successfully. Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.coordination [None req-36812a6c-dc31-495b-8ff7-363c8d6afd03 tempest-TaggedBootDevicesTest-226254012 None] Lock "cinder-453b7855-8efd-41bd-806c-18ae2c03ac49-delete_volume" released by "delete_volume" :: held 3.607s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] get volume v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_ba0a016e-f7ab-4aac-8fb3-ecf199678570', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442690', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26103808', 'sharesmb': None, 'createtxg': '112773', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5409191627996667760', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10125312', 'logicalused': '26030080', 'compressratio': '2.59', 'rootcontext': 'none', 'default_scsi_id': 'a665d51b2c319510', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265989120', 'san:volume_id': 'a665d51b2c319510b8e88dcd4492fb4ad4257acf', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.68', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10125312', 'objsetid': '85051', 'name': 'v_ba0a016e-f7ab-4aac-8fb3-ecf199678570', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10125312', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] delete snapshot v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 of volume v_482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] snapshot v_ba0a016e-f7ab-4aac-8fb3-ecf199678570 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:04:39 user cinder-volume[73403]: DEBUG cinder.quota [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Created reservations ['6610dc1c-eb8d-472e-a754-69f462ed7761', '980a462e-7606-4053-9544-9eed8f2a5a1c', '0b47e599-070e-4392-b027-9185fcede00f', '85712b00-da56-4dcb-84c9-2a8cd3849bc2'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:04:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:04:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:04:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276188160', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:04:40 user cinder-volume[73403]: DEBUG cinder.manager [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:04:40 user cinder-volume[73403]: INFO cinder.volume.manager [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Deleted volume successfully. Apr 14 03:04:40 user cinder-volume[73403]: DEBUG cinder.coordination [None req-09491ec7-9de9-4731-bfed-9f205450b642 tempest-TaggedBootDevicesTest-226254012 None] Lock "cinder-ba0a016e-f7ab-4aac-8fb3-ecf199678570-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:04:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 req-f3fc544d-0c35-4d31-8f86-8bfb269f7814 tempest-ServerActionsTestJSON-1848627478 None] terminate connection for f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:04:48 user cinder-volume[73403]: INFO cinder.volume.manager [req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 req-f3fc544d-0c35-4d31-8f86-8bfb269f7814 tempest-ServerActionsTestJSON-1848627478 None] Terminate volume connection completed successfully. Apr 14 03:04:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 req-f3fc544d-0c35-4d31-8f86-8bfb269f7814 tempest-ServerActionsTestJSON-1848627478 None] Deleting attachment b82136c5-0a81-44df-924e-153ad5a7bedd. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:04:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 req-f3fc544d-0c35-4d31-8f86-8bfb269f7814 tempest-ServerActionsTestJSON-1848627478 None] remove_export for volume: f0c626e1-cd60-46d3-b894-a000a5cb3811. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:04:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 req-f3fc544d-0c35-4d31-8f86-8bfb269f7814 tempest-ServerActionsTestJSON-1848627478 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:04:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 req-f3fc544d-0c35-4d31-8f86-8bfb269f7814 tempest-ServerActionsTestJSON-1848627478 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-324770688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f0c626e1-cd60-46d3-b894-a000a5cb3811,launched_at=2023-04-14T03:01:44Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='4075885e26cb4adaad24d3ae6217fe35',provider_auth='CHAP cpDvVdUM bkHZ1xmYjIoWs5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:01:43Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:04:47Z,use_quota=True,user_id='7dea23743ba945c4a9d539b8e277c653',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:04:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 req-f3fc544d-0c35-4d31-8f86-8bfb269f7814 tempest-ServerActionsTestJSON-1848627478 None] detach volume v_f0c626e1-cd60-46d3-b894-a000a5cb3811 from target iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:04:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 req-f3fc544d-0c35-4d31-8f86-8bfb269f7814 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/luns/v_f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 req-f3fc544d-0c35-4d31-8f86-8bfb269f7814 tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/luns/v_f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 req-f3fc544d-0c35-4d31-8f86-8bfb269f7814 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/luns/v_f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 req-f3fc544d-0c35-4d31-8f86-8bfb269f7814 tempest-ServerActionsTestJSON-1848627478 None] delete target: iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:04:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 req-f3fc544d-0c35-4d31-8f86-8bfb269f7814 tempest-ServerActionsTestJSON-1848627478 None] delete target iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:04:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 req-f3fc544d-0c35-4d31-8f86-8bfb269f7814 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:04:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 req-f3fc544d-0c35-4d31-8f86-8bfb269f7814 tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:04:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 req-f3fc544d-0c35-4d31-8f86-8bfb269f7814 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:04:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b267b527-e1c3-47a0-bd22-6a6eed5e6b96 req-f3fc544d-0c35-4d31-8f86-8bfb269f7814 tempest-ServerActionsTestJSON-1848627478 None] target iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:05:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:05:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:05:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:05:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:05:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:05:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114275885056', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:05:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:05:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:05:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=28,cinder:INSERT=2,cinder:UPDATE=13 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=18,cinder:DELETE=2,cinder:INSERT=3,cinder:UPDATE=14 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:19 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:05:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Flow 'volume_create_manager' (56391f01-e841-4e93-8a8c-bf2a01fef7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:05:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ece9f9-76b8-4359-a532-a8091305964c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:05:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ece9f9-76b8-4359-a532-a8091305964c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-57962786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5106df68-dc27-4e16-9ea7-9c77a3d4ca23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a991a4fd13b4a819b24479a341ba08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:05:19Z,use_quota=True,user_id='17999fdd4eb449d49d74b4de20f6614a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:05:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (973757fe-6943-42fb-a368-f188cc36d819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:05:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (973757fe-6943-42fb-a368-f188cc36d819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:05:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0271dc17-2c76-405c-805b-148564b2a080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:05:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0271dc17-2c76-405c-805b-148564b2a080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5106df68-dc27-4e16-9ea7-9c77a3d4ca23', 'volume_name': 'volume-5106df68-dc27-4e16-9ea7-9c77a3d4ca23', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:05:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb91a6b1-6c49-4ebb-ba11-2d3c3db58967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:05:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb91a6b1-6c49-4ebb-ba11-2d3c3db58967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:05:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db6b758-ed34-418b-af6d-6e77075cc155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:05:19 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Volume 5106df68-dc27-4e16-9ea7-9c77a3d4ca23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5106df68-dc27-4e16-9ea7-9c77a3d4ca23', 'volume_size': 1} Apr 14 03:05:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] creating volume v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:05:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] create volume {'name': 'v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:05:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:05:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:05:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23', 'is_clone': False, 'name': 'v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:05:20 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db6b758-ed34-418b-af6d-6e77075cc155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5106df68-dc27-4e16-9ea7-9c77a3d4ca23', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:05:20 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb47fd1-d026-44be-8b6f-6941abeaa2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:05:20 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Volume volume-5106df68-dc27-4e16-9ea7-9c77a3d4ca23 (5106df68-dc27-4e16-9ea7-9c77a3d4ca23): created successfully Apr 14 03:05:20 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb47fd1-d026-44be-8b6f-6941abeaa2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:05:20 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Flow 'volume_create_manager' (56391f01-e841-4e93-8a8c-bf2a01fef7de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:05:20 user cinder-volume[73403]: INFO cinder.volume.manager [None req-2cb4fc9b-ac47-4914-8529-25802d729620 tempest-TaggedAttachmentsTest-1835109148 None] Created volume successfully. Apr 14 03:05:25 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:05:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Flow 'volume_create_manager' (ba5b8255-3643-443c-820c-40850278ba25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:05:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eee2075-7e43-4a9c-8fff-90ae7b59d289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:05:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eee2075-7e43-4a9c-8fff-90ae7b59d289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-628270412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c2a62774-7c33-4899-b77f-cf1bfa85175a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f021342634dd4f16bf2720533070154c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:05:26Z,use_quota=True,user_id='0dbce21e767a4a61b9213e38523d247e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:05:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd7a382-c63c-4245-aafd-08d0bd24ebc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:05:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd7a382-c63c-4245-aafd-08d0bd24ebc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:05:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1a9086-4c23-43a2-ac5b-3ab7fd497f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:05:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1a9086-4c23-43a2-ac5b-3ab7fd497f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2a62774-7c33-4899-b77f-cf1bfa85175a', 'volume_name': 'volume-c2a62774-7c33-4899-b77f-cf1bfa85175a', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:05:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c651e4-82a6-4161-8705-74f370d168c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:05:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c651e4-82a6-4161-8705-74f370d168c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:05:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ea3b2a-4723-4c8e-bebc-09d5e14777b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:05:26 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Volume c2a62774-7c33-4899-b77f-cf1bfa85175a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2a62774-7c33-4899-b77f-cf1bfa85175a', 'volume_size': 1} Apr 14 03:05:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] creating volume v_c2a62774-7c33-4899-b77f-cf1bfa85175a. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:05:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] create volume {'name': 'v_c2a62774-7c33-4899-b77f-cf1bfa85175a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:05:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:05:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:05:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c2a62774-7c33-4899-b77f-cf1bfa85175a', 'is_clone': False, 'name': 'v_c2a62774-7c33-4899-b77f-cf1bfa85175a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:05:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ea3b2a-4723-4c8e-bebc-09d5e14777b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2a62774-7c33-4899-b77f-cf1bfa85175a', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:05:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e5ac5e-bf8f-4d2a-b6f1-bf13ceb21d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:05:27 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Volume volume-c2a62774-7c33-4899-b77f-cf1bfa85175a (c2a62774-7c33-4899-b77f-cf1bfa85175a): created successfully Apr 14 03:05:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e5ac5e-bf8f-4d2a-b6f1-bf13ceb21d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:05:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Flow 'volume_create_manager' (ba5b8255-3643-443c-820c-40850278ba25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:05:27 user cinder-volume[73403]: INFO cinder.volume.manager [None req-6d9086f8-dbda-48c9-a1d7-ea00d1018269 tempest-ServersNegativeTestJSON-675126189 None] Created volume successfully. Apr 14 03:05:42 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:05:52 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=18,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:01 user cinder-volume[73403]: DEBUG cinder.coordination [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Acquiring lock "cinder-80d66b06-08ad-4e2d-b0b7-5906492cd660-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:06:01 user cinder-volume[73403]: DEBUG cinder.coordination [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Lock "cinder-80d66b06-08ad-4e2d-b0b7-5906492cd660-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:06:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] remove_export for volume: 80d66b06-08ad-4e2d-b0b7-5906492cd660. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:06:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:06:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1171189618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=80d66b06-08ad-4e2d-b0b7-5906492cd660,launched_at=2023-04-14T03:01:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f987064bf0ed4a2fa8714064fe8b43c8',provider_auth='CHAP FGovYJtj Gl8HmxdDhXEIVU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:01:51Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:06:02Z,updated_at=2023-04-14T03:06:02Z,use_quota=True,user_id='f089c5c093754f8082181a8fc1c002f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:06:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] detach volume v_80d66b06-08ad-4e2d-b0b7-5906492cd660 from target iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:06:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660/luns/v_80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660/luns/v_80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660/luns/v_80d66b06-08ad-4e2d-b0b7-5906492cd660'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660/luns/v_80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] failed to remove resource iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 because of JDSS resource v_80d66b06-08ad-4e2d-b0b7-5906492cd660 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:06:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] delete target: iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:06:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] delete target iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:06:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] failed to remove resource iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 because of JDSS resource iqn.2010-10.org.openstack:80d66b06-08ad-4e2d-b0b7-5906492cd660 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:06:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] deleating volume v_80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:06:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] get snapshots for volume v_80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:06:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80d66b06-08ad-4e2d-b0b7-5906492cd660/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80d66b06-08ad-4e2d-b0b7-5906492cd660/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80d66b06-08ad-4e2d-b0b7-5906492cd660/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] get volume v_80d66b06-08ad-4e2d-b0b7-5906492cd660 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:06:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_80d66b06-08ad-4e2d-b0b7-5906492cd660', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442720', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112818', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10722295497748399744', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '834f0790455c8353', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275725312', 'san:volume_id': '834f0790455c83536f7f8f33f2316bbb4755168b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84332', 'name': 'v_80d66b06-08ad-4e2d-b0b7-5906492cd660', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] delete volume:v_80d66b06-08ad-4e2d-b0b7-5906492cd660 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:06:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:06:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:06:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:06:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114275794944', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:06:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80d66b06-08ad-4e2d-b0b7-5906492cd660 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] volume v_80d66b06-08ad-4e2d-b0b7-5906492cd660 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:06:04 user cinder-volume[73403]: DEBUG cinder.quota [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Created reservations ['83eba1be-cf20-466a-978d-17f9ca69076c', 'fe91d641-eb68-47ba-9305-74af32c35b13', 'f6ac0902-a28d-4712-90d6-632ce0d7cfe7', '6f820032-67c3-4e32-a7f5-91ee583b49e4'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:06:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:06:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:06:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:04 user cinder-volume[73403]: DEBUG cinder.coordination [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Acquiring lock "cinder-0032d61d-2851-4bde-b7cd-42043f3b1a7f-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:06:04 user cinder-volume[73403]: DEBUG cinder.coordination [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Lock "cinder-0032d61d-2851-4bde-b7cd-42043f3b1a7f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:06:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] remove_export for volume: 0032d61d-2851-4bde-b7cd-42043f3b1a7f. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:06:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:06:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1687729802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0032d61d-2851-4bde-b7cd-42043f3b1a7f,launched_at=2023-04-14T03:01:50Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f987064bf0ed4a2fa8714064fe8b43c8',provider_auth='CHAP DtCpadIK eUsmbH1Qj5ZP0o',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:01:49Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:06:05Z,updated_at=2023-04-14T03:06:05Z,use_quota=True,user_id='f089c5c093754f8082181a8fc1c002f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:06:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] detach volume v_0032d61d-2851-4bde-b7cd-42043f3b1a7f from target iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:06:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/luns/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/luns/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Geting {'code': 200, 'error': None, 'data': {'available': '114275794944', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.manager [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/luns/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f/luns/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] failed to remove resource iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f because of JDSS resource v_0032d61d-2851-4bde-b7cd-42043f3b1a7f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] delete target: iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] delete target iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:05 user cinder-volume[73403]: INFO cinder.volume.manager [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Deleted volume successfully. Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.coordination [None req-6d345f83-a59f-4e9c-8f89-bfbc136a47c4 tempest-TestVolumeSwap-1328008515 None] Lock "cinder-80d66b06-08ad-4e2d-b0b7-5906492cd660-delete_volume" released by "delete_volume" :: held 3.341s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] failed to remove resource iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f because of JDSS resource iqn.2010-10.org.openstack:0032d61d-2851-4bde-b7cd-42043f3b1a7f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] deleating volume v_0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] get snapshots for volume v_0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] get volume v_0032d61d-2851-4bde-b7cd-42043f3b1a7f info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442718', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112810', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13706507705198360505', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a2e53c70c7f5fd28', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275794944', 'san:volume_id': 'a2e53c70c7f5fd286a3fafb91b9cb33efb5179f9', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84322', 'name': 'v_0032d61d-2851-4bde-b7cd-42043f3b1a7f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] delete volume:v_0032d61d-2851-4bde-b7cd-42043f3b1a7f recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0032d61d-2851-4bde-b7cd-42043f3b1a7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] volume v_0032d61d-2851-4bde-b7cd-42043f3b1a7f deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:06:07 user cinder-volume[73403]: DEBUG cinder.quota [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Created reservations ['fddb6406-88e5-4cd4-91f4-367897b60aae', '2a6694b0-aec9-4e96-abbd-4f3e0167bab7', '7b755318-c5f3-4c5d-a1ba-9c45bbb4955e', 'b0ce865b-e6ce-4bd7-868d-b14dd46aea27'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:06:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:06:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:06:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Geting {'code': 200, 'error': None, 'data': {'available': '114275876864', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:06:08 user cinder-volume[73403]: DEBUG cinder.manager [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:08 user cinder-volume[73403]: INFO cinder.volume.manager [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Deleted volume successfully. Apr 14 03:06:08 user cinder-volume[73403]: DEBUG cinder.coordination [None req-84e51086-6fa1-4bd8-b268-b49f047d0d27 tempest-TestVolumeSwap-1328008515 None] Lock "cinder-0032d61d-2851-4bde-b7cd-42043f3b1a7f-delete_volume" released by "delete_volume" :: held 3.403s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG cinder.coordination [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Acquiring lock "cinder-95596aa7-5fd3-48b5-a091-0379a2e77fcc-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG cinder.coordination [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Lock "cinder-95596aa7-5fd3-48b5-a091-0379a2e77fcc-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=28,cinder:UPDATE=16,cinder:INSERT=3,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] remove_export for volume: 95596aa7-5fd3-48b5-a091-0379a2e77fcc. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-334653703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=95596aa7-5fd3-48b5-a091-0379a2e77fcc,launched_at=2023-04-14T03:02:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6371b4c05df843da9b134e12994c1d7a',provider_auth='CHAP pTqrRZGK z1aos7EuI9tcb4',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:02:28Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=3c3ed512-4929-421f-b8d6-cf222944553d,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:06:16Z,updated_at=2023-04-14T03:06:16Z,use_quota=True,user_id='337e2d8118324215b5a0baa36a5895b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] detach volume v_95596aa7-5fd3-48b5-a091-0379a2e77fcc from target iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc/luns/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc/luns/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc/luns/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc/luns/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] failed to remove resource iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc because of JDSS resource v_95596aa7-5fd3-48b5-a091-0379a2e77fcc DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] delete target: iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] delete target iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] failed to remove resource iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc because of JDSS resource iqn.2010-10.org.openstack:95596aa7-5fd3-48b5-a091-0379a2e77fcc DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] deleating volume v_95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] get snapshots for volume v_95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] get volume v_95596aa7-5fd3-48b5-a091-0379a2e77fcc info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_3c3ed512-4929-421f-b8d6-cf222944553d@v_95596aa7-5fd3-48b5-a091-0379a2e77fcc', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442759', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '163840', 'sharesmb': None, 'createtxg': '112859', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8886326466883264209', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '90112', 'logicalused': '303104', 'compressratio': '6.16', 'rootcontext': 'none', 'default_scsi_id': '0c8ed5eabe5f71ef', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275876864', 'san:volume_id': '0c8ed5eabe5f71ef18d2b8fbac3c92a92e9fa34d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '15.30', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '90112', 'objsetid': '85098', 'name': 'v_95596aa7-5fd3-48b5-a091-0379a2e77fcc', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '90112', 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] delete snapshot v_95596aa7-5fd3-48b5-a091-0379a2e77fcc of volume s_3c3ed512-4929-421f-b8d6-cf222944553d {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c3ed512-4929-421f-b8d6-cf222944553d/snapshots/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c3ed512-4929-421f-b8d6-cf222944553d/snapshots/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-9c9b5e17-d047-4e33-adb9-00bfa81a8d6d tempest-TestVolumeBootPattern-910285030 None] terminate connection for 423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:06:16 user cinder-volume[73403]: INFO cinder.volume.manager [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-9c9b5e17-d047-4e33-adb9-00bfa81a8d6d tempest-TestVolumeBootPattern-910285030 None] Terminate volume connection completed successfully. Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-9c9b5e17-d047-4e33-adb9-00bfa81a8d6d tempest-TestVolumeBootPattern-910285030 None] Deleting attachment 45b15196-b557-451c-9c76-a4a817032cbc. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-9c9b5e17-d047-4e33-adb9-00bfa81a8d6d tempest-TestVolumeBootPattern-910285030 None] remove_export for volume: 423d87a6-a274-408c-ab7c-e91e4edfd963. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-9c9b5e17-d047-4e33-adb9-00bfa81a8d6d tempest-TestVolumeBootPattern-910285030 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-9c9b5e17-d047-4e33-adb9-00bfa81a8d6d tempest-TestVolumeBootPattern-910285030 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:04:25Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=423d87a6-a274-408c-ab7c-e91e4edfd963,launched_at=2023-04-14T03:04:28Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='2d2e49e8e92e416faebf55e3d4e0e087',provider_auth='CHAP ImLoQRXC xBo2kqKA5sZlTf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:04:25Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=f78b3968-f436-44d2-8fb3-4f3d899eeed5,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:04:36Z,use_quota=True,user_id='60e11b7ab2914209b23bf7a53791da64',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-9c9b5e17-d047-4e33-adb9-00bfa81a8d6d tempest-TestVolumeBootPattern-910285030 None] detach volume v_423d87a6-a274-408c-ab7c-e91e4edfd963 from target iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-9c9b5e17-d047-4e33-adb9-00bfa81a8d6d tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963/luns/v_423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-9c9b5e17-d047-4e33-adb9-00bfa81a8d6d tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963/luns/v_423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-9c9b5e17-d047-4e33-adb9-00bfa81a8d6d tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963/luns/v_423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-9c9b5e17-d047-4e33-adb9-00bfa81a8d6d tempest-TestVolumeBootPattern-910285030 None] delete target: iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-9c9b5e17-d047-4e33-adb9-00bfa81a8d6d tempest-TestVolumeBootPattern-910285030 None] delete target iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-9c9b5e17-d047-4e33-adb9-00bfa81a8d6d tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-9c9b5e17-d047-4e33-adb9-00bfa81a8d6d tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-9c9b5e17-d047-4e33-adb9-00bfa81a8d6d tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-9c9b5e17-d047-4e33-adb9-00bfa81a8d6d tempest-TestVolumeBootPattern-910285030 None] target iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.coordination [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Acquiring lock "cinder-423d87a6-a274-408c-ab7c-e91e4edfd963-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.coordination [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-423d87a6-a274-408c-ab7c-e91e4edfd963-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] remove_export for volume: 423d87a6-a274-408c-ab7c-e91e4edfd963. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:04:25Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=423d87a6-a274-408c-ab7c-e91e4edfd963,launched_at=2023-04-14T03:04:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2e49e8e92e416faebf55e3d4e0e087',provider_auth='CHAP ImLoQRXC xBo2kqKA5sZlTf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:04:25Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=f78b3968-f436-44d2-8fb3-4f3d899eeed5,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:06:17Z,updated_at=2023-04-14T03:06:17Z,use_quota=True,user_id='60e11b7ab2914209b23bf7a53791da64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] detach volume v_423d87a6-a274-408c-ab7c-e91e4edfd963 from target iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963/luns/v_423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963/luns/v_423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963/luns/v_423d87a6-a274-408c-ab7c-e91e4edfd963'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963/luns/v_423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] failed to remove resource iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 because of JDSS resource v_423d87a6-a274-408c-ab7c-e91e4edfd963 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] delete target: iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] delete target iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] failed to remove resource iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 because of JDSS resource iqn.2010-10.org.openstack:423d87a6-a274-408c-ab7c-e91e4edfd963 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] deleating volume v_423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] get snapshots for volume v_423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_423d87a6-a274-408c-ab7c-e91e4edfd963/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_423d87a6-a274-408c-ab7c-e91e4edfd963/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c3ed512-4929-421f-b8d6-cf222944553d/snapshots/v_95596aa7-5fd3-48b5-a091-0379a2e77fcc {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] snapshot v_95596aa7-5fd3-48b5-a091-0379a2e77fcc deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.quota [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Created reservations ['8653e01a-2e65-42f1-83c2-4edc112118ce', 'f0c7a2f7-96d3-4c7a-8715-ca6c9ae80319', '1f639fba-46c9-4c1b-beff-96f89a7ad043', 'f34b85c4-9770-4802-aeb4-1e0207d0ffd3'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_423d87a6-a274-408c-ab7c-e91e4edfd963/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] get volume v_423d87a6-a274-408c-ab7c-e91e4edfd963 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5@v_423d87a6-a274-408c-ab7c-e91e4edfd963', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_423d87a6-a274-408c-ab7c-e91e4edfd963', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442875', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26112000', 'sharesmb': None, 'createtxg': '112940', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '78883806518434343', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '274432', 'logicalused': '1228800', 'compressratio': '5.45', 'rootcontext': 'none', 'default_scsi_id': '66e744c9dad82263', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276016128', 'san:volume_id': '66e744c9dad82263ba52569ec687846184e75563', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '274432', 'objsetid': '85381', 'name': 'v_423d87a6-a274-408c-ab7c-e91e4edfd963', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '274432', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] delete snapshot v_423d87a6-a274-408c-ab7c-e91e4edfd963 of volume s_f78b3968-f436-44d2-8fb3-4f3d899eeed5 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5/snapshots/v_423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5/snapshots/v_423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276016128', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:06:18 user cinder-volume[73403]: DEBUG cinder.manager [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:18 user cinder-volume[73403]: INFO cinder.volume.manager [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Deleted volume successfully. Apr 14 03:06:18 user cinder-volume[73403]: DEBUG cinder.coordination [None req-430d2965-bdf0-45d4-82ac-aa684ecba725 tempest-TestStampPattern-323884970 None] Lock "cinder-95596aa7-5fd3-48b5-a091-0379a2e77fcc-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8339a1b8-93a8-4585-aff1-3e1b00693058 tempest-TestStampPattern-323884970 None] Acquiring lock "cinder-3c3ed512-4929-421f-b8d6-cf222944553d-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8339a1b8-93a8-4585-aff1-3e1b00693058 tempest-TestStampPattern-323884970 None] Lock "cinder-3c3ed512-4929-421f-b8d6-cf222944553d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8339a1b8-93a8-4585-aff1-3e1b00693058 tempest-TestStampPattern-323884970 None] deleating snapshot s_3c3ed512-4929-421f-b8d6-cf222944553d. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8339a1b8-93a8-4585-aff1-3e1b00693058 tempest-TestStampPattern-323884970 None] get snapshots for volume s_3c3ed512-4929-421f-b8d6-cf222944553d {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8339a1b8-93a8-4585-aff1-3e1b00693058 tempest-TestStampPattern-323884970 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c3ed512-4929-421f-b8d6-cf222944553d/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8339a1b8-93a8-4585-aff1-3e1b00693058 tempest-TestStampPattern-323884970 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c3ed512-4929-421f-b8d6-cf222944553d/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5/snapshots/v_423d87a6-a274-408c-ab7c-e91e4edfd963 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] snapshot v_423d87a6-a274-408c-ab7c-e91e4edfd963 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.quota [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Created reservations ['590937c4-bc5a-47bf-a8ad-fb0f5bd199eb', '274bc009-ffb3-4146-88c3-0b9095bb002a', '5036fd79-8839-4285-8cd1-55d87af86ab6', '15c3d275-ac6b-4220-9916-32150ce5e67b'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8339a1b8-93a8-4585-aff1-3e1b00693058 tempest-TestStampPattern-323884970 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c3ed512-4929-421f-b8d6-cf222944553d/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8339a1b8-93a8-4585-aff1-3e1b00693058 tempest-TestStampPattern-323884970 None] get volume s_3c3ed512-4929-421f-b8d6-cf222944553d info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8339a1b8-93a8-4585-aff1-3e1b00693058 tempest-TestStampPattern-323884970 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c3ed512-4929-421f-b8d6-cf222944553d {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8339a1b8-93a8-4585-aff1-3e1b00693058 tempest-TestStampPattern-323884970 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c3ed512-4929-421f-b8d6-cf222944553d {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=57,cinder:UPDATE=31,cinder:INSERT=10,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8339a1b8-93a8-4585-aff1-3e1b00693058 tempest-TestStampPattern-323884970 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_edd92bd4-26a2-4652-bdc6-77805711142a@s_3c3ed512-4929-421f-b8d6-cf222944553d', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_3c3ed512-4929-421f-b8d6-cf222944553d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442748', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '163840', 'sharesmb': None, 'createtxg': '112839', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15976657200125097708', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'dc927ef96e39666f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276339712', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '15.30', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '84343', 'name': 's_3c3ed512-4929-421f-b8d6-cf222944553d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c3ed512-4929-421f-b8d6-cf222944553d {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8339a1b8-93a8-4585-aff1-3e1b00693058 tempest-TestStampPattern-323884970 None] delete snapshot s_3c3ed512-4929-421f-b8d6-cf222944553d of volume v_edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8339a1b8-93a8-4585-aff1-3e1b00693058 tempest-TestStampPattern-323884970 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd92bd4-26a2-4652-bdc6-77805711142a/snapshots/s_3c3ed512-4929-421f-b8d6-cf222944553d {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8339a1b8-93a8-4585-aff1-3e1b00693058 tempest-TestStampPattern-323884970 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd92bd4-26a2-4652-bdc6-77805711142a/snapshots/s_3c3ed512-4929-421f-b8d6-cf222944553d {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276327424', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:06:20 user cinder-volume[73403]: DEBUG cinder.manager [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:20 user cinder-volume[73403]: INFO cinder.volume.manager [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Deleted volume successfully. Apr 14 03:06:20 user cinder-volume[73403]: DEBUG cinder.coordination [req-502bcf7c-014b-4c72-968d-d7b5bb93e5c7 req-749407eb-d5b4-45d3-aac4-3f0b7d0e1779 tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-423d87a6-a274-408c-ab7c-e91e4edfd963-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:06:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8339a1b8-93a8-4585-aff1-3e1b00693058 tempest-TestStampPattern-323884970 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd92bd4-26a2-4652-bdc6-77805711142a/snapshots/s_3c3ed512-4929-421f-b8d6-cf222944553d {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8339a1b8-93a8-4585-aff1-3e1b00693058 tempest-TestStampPattern-323884970 None] snapshot s_3c3ed512-4929-421f-b8d6-cf222944553d deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:06:21 user cinder-volume[73403]: DEBUG cinder.quota [None req-8339a1b8-93a8-4585-aff1-3e1b00693058 tempest-TestStampPattern-323884970 None] Created reservations ['606e5e6d-fbb4-4a02-8b9f-e3b812debbdb', 'df1a3ec5-0d69-47e4-8e3c-345c9db81e86', 'f1c36a61-2de9-4c5d-8cfd-953a3a274fc1', '18f44a39-cdce-4482-baa8-44a4d034b728'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:06:21 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8339a1b8-93a8-4585-aff1-3e1b00693058 tempest-TestStampPattern-323884970 None] Delete snapshot completed successfully. Apr 14 03:06:21 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8339a1b8-93a8-4585-aff1-3e1b00693058 tempest-TestStampPattern-323884970 None] Lock "cinder-3c3ed512-4929-421f-b8d6-cf222944553d-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:06:25 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:06:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Flow 'volume_create_manager' (403993e6-2fe3-4d00-9a17-4dab6e7905dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:06:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb843a65-d9ad-435c-a47f-251e840bf767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb843a65-d9ad-435c-a47f-251e840bf767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-509802863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=05d362e8-1aaf-4bbb-8a9f-9f153920e00c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='558bfd7e1d9049d396381de148b0c4a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:06:25Z,use_quota=True,user_id='d5e8150f1502427fb3148f20354d212e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01e3aca-3462-498d-b7a9-331a5c384d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01e3aca-3462-498d-b7a9-331a5c384d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc07a6bb-1f78-4a38-8d17-e6bf16214c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc07a6bb-1f78-4a38-8d17-e6bf16214c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d362e8-1aaf-4bbb-8a9f-9f153920e00c', 'volume_name': 'volume-05d362e8-1aaf-4bbb-8a9f-9f153920e00c', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f56ca87-6d95-494a-9a09-755bd8a9a546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f56ca87-6d95-494a-9a09-755bd8a9a546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c8acf3-4e60-4712-9167-4a4d9d51538a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:25 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Volume 05d362e8-1aaf-4bbb-8a9f-9f153920e00c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d362e8-1aaf-4bbb-8a9f-9f153920e00c', 'volume_size': 1} Apr 14 03:06:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] creating volume v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:06:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] create volume {'name': 'v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:06:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c', 'is_clone': False, 'name': 'v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c8acf3-4e60-4712-9167-4a4d9d51538a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d362e8-1aaf-4bbb-8a9f-9f153920e00c', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43444218-ebdb-4556-bf3c-532fa8662c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:26 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Volume volume-05d362e8-1aaf-4bbb-8a9f-9f153920e00c (05d362e8-1aaf-4bbb-8a9f-9f153920e00c): created successfully Apr 14 03:06:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43444218-ebdb-4556-bf3c-532fa8662c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Flow 'volume_create_manager' (403993e6-2fe3-4d00-9a17-4dab6e7905dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:06:26 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a4c73336-3c56-4156-b6f8-f0c1e606def1 tempest-ServerRescueNegativeTestJSON-773851452 None] Created volume successfully. Apr 14 03:06:28 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Acquiring lock "cinder-c2a62774-7c33-4899-b77f-cf1bfa85175a-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:06:28 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Lock "cinder-c2a62774-7c33-4899-b77f-cf1bfa85175a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:06:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] remove_export for volume: c2a62774-7c33-4899-b77f-cf1bfa85175a. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:06:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:06:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-628270412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c2a62774-7c33-4899-b77f-cf1bfa85175a,launched_at=2023-04-14T03:05:27Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f021342634dd4f16bf2720533070154c',provider_auth='CHAP IQZiOKTE 1r8UKdoOXMILnz',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a62774-7c33-4899-b77f-cf1bfa85175a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:05:26Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:06:28Z,updated_at=2023-04-14T03:06:28Z,use_quota=True,user_id='0dbce21e767a4a61b9213e38523d247e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:c2a62774-7c33-4899-b77f-cf1bfa85175a. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:06:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] detach volume v_c2a62774-7c33-4899-b77f-cf1bfa85175a from target iqn.2010-10.org.openstack:c2a62774-7c33-4899-b77f-cf1bfa85175a {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:06:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2a62774-7c33-4899-b77f-cf1bfa85175a/luns/v_c2a62774-7c33-4899-b77f-cf1bfa85175a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2a62774-7c33-4899-b77f-cf1bfa85175a/luns/v_c2a62774-7c33-4899-b77f-cf1bfa85175a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c2a62774-7c33-4899-b77f-cf1bfa85175a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2a62774-7c33-4899-b77f-cf1bfa85175a/luns/v_c2a62774-7c33-4899-b77f-cf1bfa85175a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2a62774-7c33-4899-b77f-cf1bfa85175a/luns/v_c2a62774-7c33-4899-b77f-cf1bfa85175a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] failed to remove resource iqn.2010-10.org.openstack:c2a62774-7c33-4899-b77f-cf1bfa85175a because of JDSS resource v_c2a62774-7c33-4899-b77f-cf1bfa85175a DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:06:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] delete target: iqn.2010-10.org.openstack:c2a62774-7c33-4899-b77f-cf1bfa85175a {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:06:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] delete target iqn.2010-10.org.openstack:c2a62774-7c33-4899-b77f-cf1bfa85175a {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:06:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2a62774-7c33-4899-b77f-cf1bfa85175a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2a62774-7c33-4899-b77f-cf1bfa85175a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c2a62774-7c33-4899-b77f-cf1bfa85175a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2a62774-7c33-4899-b77f-cf1bfa85175a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2a62774-7c33-4899-b77f-cf1bfa85175a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] failed to remove resource iqn.2010-10.org.openstack:c2a62774-7c33-4899-b77f-cf1bfa85175a because of JDSS resource iqn.2010-10.org.openstack:c2a62774-7c33-4899-b77f-cf1bfa85175a DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:06:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] deleating volume v_c2a62774-7c33-4899-b77f-cf1bfa85175a {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:06:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] get snapshots for volume v_c2a62774-7c33-4899-b77f-cf1bfa85175a {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:06:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c2a62774-7c33-4899-b77f-cf1bfa85175a/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c2a62774-7c33-4899-b77f-cf1bfa85175a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c2a62774-7c33-4899-b77f-cf1bfa85175a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] get volume v_c2a62774-7c33-4899-b77f-cf1bfa85175a info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:06:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c2a62774-7c33-4899-b77f-cf1bfa85175a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c2a62774-7c33-4899-b77f-cf1bfa85175a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c2a62774-7c33-4899-b77f-cf1bfa85175a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442935', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112974', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4609337978865550326', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '28f5760f3bab3f03', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276302848', 'san:volume_id': '28f5760f3bab3f03ee3fea2950fed08e99a9d679', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85804', 'name': 'v_c2a62774-7c33-4899-b77f-cf1bfa85175a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c2a62774-7c33-4899-b77f-cf1bfa85175a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] delete volume:v_c2a62774-7c33-4899-b77f-cf1bfa85175a recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:06:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c2a62774-7c33-4899-b77f-cf1bfa85175a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c2a62774-7c33-4899-b77f-cf1bfa85175a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c2a62774-7c33-4899-b77f-cf1bfa85175a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] volume v_c2a62774-7c33-4899-b77f-cf1bfa85175a deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:06:30 user cinder-volume[73403]: DEBUG cinder.quota [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Created reservations ['10165ec3-32fe-400d-aae1-11e865ed30c8', '1e8a52fb-6786-455b-8923-61734c03a75a', '8015212a-dfaa-4bf2-b6a4-0d293b8cf79d', '722b4ada-be71-47af-9a88-305040841404'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:06:30 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=50,cinder:UPDATE=43,cinder:INSERT=5,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:06:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:06:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Flow 'volume_create_manager' (3d5363d9-da01-494e-91a2-5c9a12d30f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18485f6e-edda-4106-9676-94901db0fc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18485f6e-edda-4106-9676-94901db0fc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1083887677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d7ac81e3-c104-4bb3-ada5-ecd6969601f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d531e7f7004ebaa529cb60de3849e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:06:31Z,use_quota=True,user_id='5a311491e2924c49b01fd42458ec2fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e7350f2-6c54-472f-98eb-2cf18d5fe16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e7350f2-6c54-472f-98eb-2cf18d5fe16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26796a49-f363-4789-b68a-2ed2fc1553a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276384768', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.manager [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:31 user cinder-volume[73403]: INFO cinder.volume.manager [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Deleted volume successfully. Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26796a49-f363-4789-b68a-2ed2fc1553a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd7ac81e3-c104-4bb3-ada5-ecd6969601f0', 'volume_name': 'volume-d7ac81e3-c104-4bb3-ada5-ecd6969601f0', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9750c414-c373-4990-b570-d0522a6f518e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9750c414-c373-4990-b570-d0522a6f518e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3602b02a-e756-499c-9175-2273b2b509cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:31 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Volume d7ac81e3-c104-4bb3-ada5-ecd6969601f0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d7ac81e3-c104-4bb3-ada5-ecd6969601f0', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Cloning d7ac81e3-c104-4bb3-ada5-ecd6969601f0 from image 98e6a247-250b-4bb5-a947-e7f93598d16e at location (None, None). {{(pid=73403) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.coordination [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Acquiring lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" by "_prepare_image_cache_entry" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b40a70fc-db5c-483d-b3bf-88f5b3803846 tempest-ServersNegativeTestJSON-675126189 None] Lock "cinder-c2a62774-7c33-4899-b77f-cf1bfa85175a-delete_volume" released by "delete_volume" :: held 3.325s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.coordination [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Acquiring lock "cinder-b79b29ca-aed8-4f63-87e4-2088158dca75-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 3, 6, 31, 737336)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Found cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Lock "cinder-b79b29ca-aed8-4f63-87e4-2088158dca75-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.coordination [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" released by "_prepare_image_cache_entry" :: held 0.028s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Attempting to retrieve cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 3, 6, 31, 770721)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Creating from source image-volume 482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] cloned volume 482f938f-083c-4221-99f8-3320a80b8725 to d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] cloning v_482f938f-083c-4221-99f8-3320a80b8725 to v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] create snapshot v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] remove_export for volume: b79b29ca-aed8-4f63-87e4-2088158dca75. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1934265615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b79b29ca-aed8-4f63-87e4-2088158dca75,launched_at=2023-04-14T03:03:23Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f021342634dd4f16bf2720533070154c',provider_auth='CHAP RPLBGIsU DzlSj1RcECdnar',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79b29ca-aed8-4f63-87e4-2088158dca75 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:03:22Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:06:32Z,updated_at=2023-04-14T03:06:32Z,use_quota=True,user_id='0dbce21e767a4a61b9213e38523d247e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:b79b29ca-aed8-4f63-87e4-2088158dca75. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] detach volume v_b79b29ca-aed8-4f63-87e4-2088158dca75 from target iqn.2010-10.org.openstack:b79b29ca-aed8-4f63-87e4-2088158dca75 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b79b29ca-aed8-4f63-87e4-2088158dca75/luns/v_b79b29ca-aed8-4f63-87e4-2088158dca75 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b79b29ca-aed8-4f63-87e4-2088158dca75/luns/v_b79b29ca-aed8-4f63-87e4-2088158dca75 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b79b29ca-aed8-4f63-87e4-2088158dca75 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b79b29ca-aed8-4f63-87e4-2088158dca75/luns/v_b79b29ca-aed8-4f63-87e4-2088158dca75'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b79b29ca-aed8-4f63-87e4-2088158dca75/luns/v_b79b29ca-aed8-4f63-87e4-2088158dca75 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] failed to remove resource iqn.2010-10.org.openstack:b79b29ca-aed8-4f63-87e4-2088158dca75 because of JDSS resource v_b79b29ca-aed8-4f63-87e4-2088158dca75 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] delete target: iqn.2010-10.org.openstack:b79b29ca-aed8-4f63-87e4-2088158dca75 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] delete target iqn.2010-10.org.openstack:b79b29ca-aed8-4f63-87e4-2088158dca75 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b79b29ca-aed8-4f63-87e4-2088158dca75 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b79b29ca-aed8-4f63-87e4-2088158dca75 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b79b29ca-aed8-4f63-87e4-2088158dca75 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b79b29ca-aed8-4f63-87e4-2088158dca75'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b79b29ca-aed8-4f63-87e4-2088158dca75 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] failed to remove resource iqn.2010-10.org.openstack:b79b29ca-aed8-4f63-87e4-2088158dca75 because of JDSS resource iqn.2010-10.org.openstack:b79b29ca-aed8-4f63-87e4-2088158dca75 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] deleating volume v_b79b29ca-aed8-4f63-87e4-2088158dca75 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] get snapshots for volume v_b79b29ca-aed8-4f63-87e4-2088158dca75 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b79b29ca-aed8-4f63-87e4-2088158dca75/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b79b29ca-aed8-4f63-87e4-2088158dca75/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b79b29ca-aed8-4f63-87e4-2088158dca75/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] get volume v_b79b29ca-aed8-4f63-87e4-2088158dca75 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:06:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b79b29ca-aed8-4f63-87e4-2088158dca75 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b79b29ca-aed8-4f63-87e4-2088158dca75 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b79b29ca-aed8-4f63-87e4-2088158dca75', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442812', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112884', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3520341616722173553', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b95689a76bd42b98', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276372480', 'san:volume_id': 'b95689a76bd42b98fa1736aa1eac6f576d8901ff', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85770', 'name': 'v_b79b29ca-aed8-4f63-87e4-2088158dca75', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b79b29ca-aed8-4f63-87e4-2088158dca75 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] delete volume:v_b79b29ca-aed8-4f63-87e4-2088158dca75 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:06:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b79b29ca-aed8-4f63-87e4-2088158dca75 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b79b29ca-aed8-4f63-87e4-2088158dca75 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] create volume v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 from snapshot v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:06:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0', 'is_clone': True, 'full_name': 'Pool-0/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0', 'name': 'v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] get volume v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:06:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443002', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '113009', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10815094216602707398', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f5238eccdcb9cf96', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276417536', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84476', 'name': 'v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:34 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Marking volume d7ac81e3-c104-4bb3-ada5-ecd6969601f0 as bootable. {{(pid=73403) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 03:06:34 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Copying metadata from image 98e6a247-250b-4bb5-a947-e7f93598d16e to d7ac81e3-c104-4bb3-ada5-ecd6969601f0. {{(pid=73403) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 03:06:34 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Creating volume glance metadata for volume d7ac81e3-c104-4bb3-ada5-ecd6969601f0 backed by image 98e6a247-250b-4bb5-a947-e7f93598d16e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73403) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 03:06:34 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3602b02a-e756-499c-9175-2273b2b509cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7ac81e3-c104-4bb3-ada5-ecd6969601f0', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:34 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e6807e-5cbf-4931-8295-9147c4b11756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:34 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Volume volume-d7ac81e3-c104-4bb3-ada5-ecd6969601f0 (d7ac81e3-c104-4bb3-ada5-ecd6969601f0): created successfully Apr 14 03:06:34 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e6807e-5cbf-4931-8295-9147c4b11756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:34 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Flow 'volume_create_manager' (3d5363d9-da01-494e-91a2-5c9a12d30f1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:06:34 user cinder-volume[73403]: INFO cinder.volume.manager [None req-21366341-15b9-4525-ab8b-ba2662251601 tempest-TaggedBootDevicesTest_v242-641324897 None] Created volume successfully. Apr 14 03:06:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b79b29ca-aed8-4f63-87e4-2088158dca75 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] volume v_b79b29ca-aed8-4f63-87e4-2088158dca75 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:06:34 user cinder-volume[73403]: DEBUG cinder.quota [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Created reservations ['2d2bc086-adb5-49a4-ad01-37103b6a751d', 'b250ee3d-cabf-4fea-a022-97781e0f0896', '767f6d24-acd8-4159-b07f-161812114322', '71ed0d21-0ba2-40e5-bf3c-320b5d3132a1'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:06:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:06:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:06:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:35 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:06:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Flow 'volume_create_manager' (acb9d7dd-aecf-4c1c-acb7-a9c96edc8b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:06:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9403754-280d-4db4-8bad-29b832d7bb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9403754-280d-4db4-8bad-29b832d7bb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1015327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f9476602-ab81-47c8-aa31-ecc8e3c672ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d531e7f7004ebaa529cb60de3849e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:06:35Z,use_quota=True,user_id='5a311491e2924c49b01fd42458ec2fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1960bc59-7c86-4a4f-a9c6-210ff13b4517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1960bc59-7c86-4a4f-a9c6-210ff13b4517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be062e4f-b870-46fb-86f9-b0b3562afde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be062e4f-b870-46fb-86f9-b0b3562afde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9476602-ab81-47c8-aa31-ecc8e3c672ee', 'volume_name': 'volume-f9476602-ab81-47c8-aa31-ecc8e3c672ee', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65991b13-ca67-46df-a7f8-5d22623d88ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65991b13-ca67-46df-a7f8-5d22623d88ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52988a1b-c535-4b56-984a-7f7a9e17dd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:35 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Volume f9476602-ab81-47c8-aa31-ecc8e3c672ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9476602-ab81-47c8-aa31-ecc8e3c672ee', 'volume_size': 1} Apr 14 03:06:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] creating volume v_f9476602-ab81-47c8-aa31-ecc8e3c672ee. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:06:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] create volume {'name': 'v_f9476602-ab81-47c8-aa31-ecc8e3c672ee', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:06:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276405248', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:06:35 user cinder-volume[73403]: DEBUG cinder.manager [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:35 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Deleted volume successfully. Apr 14 03:06:35 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8b182859-1930-4199-831a-a2ea22f433e7 tempest-ServersNegativeTestJSON-675126189 None] Lock "cinder-b79b29ca-aed8-4f63-87e4-2088158dca75-delete_volume" released by "delete_volume" :: held 3.734s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:06:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_f9476602-ab81-47c8-aa31-ecc8e3c672ee', 'is_clone': False, 'name': 'v_f9476602-ab81-47c8-aa31-ecc8e3c672ee'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52988a1b-c535-4b56-984a-7f7a9e17dd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9476602-ab81-47c8-aa31-ecc8e3c672ee', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (778c210f-c7d6-4749-8ab2-dc69f839f013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:36 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Volume volume-f9476602-ab81-47c8-aa31-ecc8e3c672ee (f9476602-ab81-47c8-aa31-ecc8e3c672ee): created successfully Apr 14 03:06:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (778c210f-c7d6-4749-8ab2-dc69f839f013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Flow 'volume_create_manager' (acb9d7dd-aecf-4c1c-acb7-a9c96edc8b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:06:36 user cinder-volume[73403]: INFO cinder.volume.manager [None req-ccf90d29-c42a-4362-b1f0-30569dbb9239 tempest-TaggedBootDevicesTest_v242-641324897 None] Created volume successfully. Apr 14 03:06:36 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=55,cinder:INSERT=15,cinder:UPDATE=27,cinder:DELETE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:37 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:06:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Flow 'volume_create_manager' (04f94c47-613e-42fe-a7da-a35366c9dcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:06:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac47851-69d8-4659-a41e-6f3d1d32ba1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac47851-69d8-4659-a41e-6f3d1d32ba1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1605752098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e178f132-e302-4ee5-8ca6-45972e24754a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d531e7f7004ebaa529cb60de3849e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:06:37Z,use_quota=True,user_id='5a311491e2924c49b01fd42458ec2fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff1d95d-ed72-421c-b339-cd983ced15ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff1d95d-ed72-421c-b339-cd983ced15ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d284e6-71d6-4faa-91c7-0017d706216a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d284e6-71d6-4faa-91c7-0017d706216a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e178f132-e302-4ee5-8ca6-45972e24754a', 'volume_name': 'volume-e178f132-e302-4ee5-8ca6-45972e24754a', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ea8458-f654-4311-bf51-ab952ddc570f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ea8458-f654-4311-bf51-ab952ddc570f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9ce91c-d1b9-4726-b054-a282687614aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:37 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Volume e178f132-e302-4ee5-8ca6-45972e24754a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e178f132-e302-4ee5-8ca6-45972e24754a', 'volume_size': 1} Apr 14 03:06:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] creating volume v_e178f132-e302-4ee5-8ca6-45972e24754a. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:06:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] create volume {'name': 'v_e178f132-e302-4ee5-8ca6-45972e24754a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:06:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:38 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:06:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Flow 'volume_create_manager' (bf7f7963-955d-48e8-91c6-6681eb4fda17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:06:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92db4ff-b9ab-435f-80d9-b0c5189b130e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e178f132-e302-4ee5-8ca6-45972e24754a', 'is_clone': False, 'name': 'v_e178f132-e302-4ee5-8ca6-45972e24754a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92db4ff-b9ab-435f-80d9-b0c5189b130e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-368917324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=44f3cbc9-fd81-4185-aa74-0896739af983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4075885e26cb4adaad24d3ae6217fe35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:06:38Z,use_quota=True,user_id='7dea23743ba945c4a9d539b8e277c653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b61dc34-ff8c-43a3-b475-e2bc346203e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b61dc34-ff8c-43a3-b475-e2bc346203e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f0ec38-5526-4c49-8865-45e9122440ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f0ec38-5526-4c49-8865-45e9122440ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44f3cbc9-fd81-4185-aa74-0896739af983', 'volume_name': 'volume-44f3cbc9-fd81-4185-aa74-0896739af983', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0928bb8-b3f3-4f75-8794-07b38aafc9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0928bb8-b3f3-4f75-8794-07b38aafc9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d81d46-ad21-4e6b-954c-abb712a6600e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:38 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Volume 44f3cbc9-fd81-4185-aa74-0896739af983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44f3cbc9-fd81-4185-aa74-0896739af983', 'volume_size': 1} Apr 14 03:06:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] creating volume v_44f3cbc9-fd81-4185-aa74-0896739af983. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:06:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] create volume {'name': 'v_44f3cbc9-fd81-4185-aa74-0896739af983', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:06:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9ce91c-d1b9-4726-b054-a282687614aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e178f132-e302-4ee5-8ca6-45972e24754a', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac3e2f4-855d-4754-88ca-c4908bff5593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:38 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Volume volume-e178f132-e302-4ee5-8ca6-45972e24754a (e178f132-e302-4ee5-8ca6-45972e24754a): created successfully Apr 14 03:06:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac3e2f4-855d-4754-88ca-c4908bff5593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Flow 'volume_create_manager' (04f94c47-613e-42fe-a7da-a35366c9dcc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:06:38 user cinder-volume[73403]: INFO cinder.volume.manager [None req-05b51be2-bfeb-445f-89ec-9bfff1a5e3ed tempest-TaggedBootDevicesTest_v242-641324897 None] Created volume successfully. Apr 14 03:06:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_44f3cbc9-fd81-4185-aa74-0896739af983', 'is_clone': False, 'name': 'v_44f3cbc9-fd81-4185-aa74-0896739af983'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d81d46-ad21-4e6b-954c-abb712a6600e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44f3cbc9-fd81-4185-aa74-0896739af983', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8e4df7-8711-4344-9156-ddc6327dd076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:06:39 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Volume volume-44f3cbc9-fd81-4185-aa74-0896739af983 (44f3cbc9-fd81-4185-aa74-0896739af983): created successfully Apr 14 03:06:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8e4df7-8711-4344-9156-ddc6327dd076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:06:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Flow 'volume_create_manager' (bf7f7963-955d-48e8-91c6-6681eb4fda17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:06:39 user cinder-volume[73403]: INFO cinder.volume.manager [None req-e2b52844-71a2-4b64-b1e1-0b40a60c3249 tempest-ServerActionsTestJSON-1848627478 None] Created volume successfully. Apr 14 03:06:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] create export for volume: 44f3cbc9-fd81-4185-aa74-0896739af983. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:06:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] ensure volume 44f3cbc9-fd81-4185-aa74-0896739af983 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:06:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] check if targe iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:06:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] create target and attach volume 44f3cbc9-fd81-4185-aa74-0896739af983 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:06:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] create target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:06:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] atach volume v_44f3cbc9-fd81-4185-aa74-0896739af983 to target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:06:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6562356334656261', 'lun': 0, 'mode': 'wt', 'name': 'v_44f3cbc9-fd81-4185-aa74-0896739af983', 'prod_id': 'Storage', 'scsi_id': 'eb5c4eba774e2823'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] add credentails to target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:06:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'name': 'rCsYcqle'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] initialize_connection for 44f3cbc9-fd81-4185-aa74-0896739af983 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:06:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rCsYcqle', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '5c1e6dd8-018f-47a4-8b6b-3e57f0957faf'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:06:44 user cinder-volume[73403]: INFO cinder.volume.manager [req-9df6022a-be13-4574-a908-5ad778bc77e7 req-a3b499fb-c34a-4a1d-a17f-7bf3b946857c tempest-ServerActionsTestJSON-1848627478 None] attachment_update completed successfully. Apr 14 03:06:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] create export for volume: d7ac81e3-c104-4bb3-ada5-ecd6969601f0. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:06:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] ensure volume d7ac81e3-c104-4bb3-ada5-ecd6969601f0 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:06:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] check if targe iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:06:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] create target and attach volume d7ac81e3-c104-4bb3-ada5-ecd6969601f0 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:06:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] create target iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:06:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-ca2a1f6a-4f26-44df-afef-9a4bbc114ad8 tempest-ServerActionsTestJSON-1848627478 None] terminate connection for 44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:06:53 user cinder-volume[73403]: INFO cinder.volume.manager [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-ca2a1f6a-4f26-44df-afef-9a4bbc114ad8 tempest-ServerActionsTestJSON-1848627478 None] Terminate volume connection completed successfully. Apr 14 03:06:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-ca2a1f6a-4f26-44df-afef-9a4bbc114ad8 tempest-ServerActionsTestJSON-1848627478 None] Deleting attachment 5c1e6dd8-018f-47a4-8b6b-3e57f0957faf. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:06:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-ca2a1f6a-4f26-44df-afef-9a4bbc114ad8 tempest-ServerActionsTestJSON-1848627478 None] remove_export for volume: 44f3cbc9-fd81-4185-aa74-0896739af983. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:06:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-ca2a1f6a-4f26-44df-afef-9a4bbc114ad8 tempest-ServerActionsTestJSON-1848627478 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:06:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-ca2a1f6a-4f26-44df-afef-9a4bbc114ad8 tempest-ServerActionsTestJSON-1848627478 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-368917324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=44f3cbc9-fd81-4185-aa74-0896739af983,launched_at=2023-04-14T03:06:39Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='4075885e26cb4adaad24d3ae6217fe35',provider_auth='CHAP rCsYcqle dmt65IHyECkAD0',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:06:38Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:06:47Z,use_quota=True,user_id='7dea23743ba945c4a9d539b8e277c653',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:06:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-ca2a1f6a-4f26-44df-afef-9a4bbc114ad8 tempest-ServerActionsTestJSON-1848627478 None] detach volume v_44f3cbc9-fd81-4185-aa74-0896739af983 from target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:06:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-ca2a1f6a-4f26-44df-afef-9a4bbc114ad8 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns/v_44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-ca2a1f6a-4f26-44df-afef-9a4bbc114ad8 tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns/v_44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] atach volume v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 to target iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:06:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-ca2a1f6a-4f26-44df-afef-9a4bbc114ad8 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns/v_44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-ca2a1f6a-4f26-44df-afef-9a4bbc114ad8 tempest-ServerActionsTestJSON-1848627478 None] delete target: iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:06:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-ca2a1f6a-4f26-44df-afef-9a4bbc114ad8 tempest-ServerActionsTestJSON-1848627478 None] delete target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:06:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-ca2a1f6a-4f26-44df-afef-9a4bbc114ad8 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-ca2a1f6a-4f26-44df-afef-9a4bbc114ad8 tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-ca2a1f6a-4f26-44df-afef-9a4bbc114ad8 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-ca2a1f6a-4f26-44df-afef-9a4bbc114ad8 tempest-ServerActionsTestJSON-1848627478 None] target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:06:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6635323338656363', 'lun': 0, 'mode': 'wt', 'name': 'v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0', 'prod_id': 'Storage', 'scsi_id': 'f5238eccdcb9cf96'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] add credentails to target iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:06:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 201, 'error': None, 'data': {'name': 'dqJMIbXg'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] initialize_connection for d7ac81e3-c104-4bb3-ada5-ecd6969601f0 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:06:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dqJMIbXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'ea74a039-df1d-4c31-9fd6-1edcb23e777d'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:06:55 user cinder-volume[73403]: INFO cinder.volume.manager [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-afac8189-f675-4243-a4a9-7b9691dab58e tempest-TaggedBootDevicesTest_v242-641324897 None] attachment_update completed successfully. Apr 14 03:06:55 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=75,cinder:UPDATE=17,cinder:INSERT=7,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:06:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] create export for volume: 44f3cbc9-fd81-4185-aa74-0896739af983. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:06:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] ensure volume 44f3cbc9-fd81-4185-aa74-0896739af983 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:06:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] check if targe iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:06:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] create target and attach volume 44f3cbc9-fd81-4185-aa74-0896739af983 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:06:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] create target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:06:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] create export for volume: f9476602-ab81-47c8-aa31-ecc8e3c672ee. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:06:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] ensure volume f9476602-ab81-47c8-aa31-ecc8e3c672ee assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:06:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] check if targe iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:06:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] create target and attach volume f9476602-ab81-47c8-aa31-ecc8e3c672ee to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:06:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] create target iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:06:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] atach volume v_44f3cbc9-fd81-4185-aa74-0896739af983 to target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:06:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] atach volume v_f9476602-ab81-47c8-aa31-ecc8e3c672ee to target iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:06:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:06:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6562356334656261', 'lun': 0, 'mode': 'wt', 'name': 'v_44f3cbc9-fd81-4185-aa74-0896739af983', 'prod_id': 'Storage', 'scsi_id': 'eb5c4eba774e2823'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:06:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] add credentails to target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:06:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:06:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3336323238646235', 'lun': 0, 'mode': 'wt', 'name': 'v_f9476602-ab81-47c8-aa31-ecc8e3c672ee', 'prod_id': 'Storage', 'scsi_id': '36228db5d3fc8e58'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] add credentails to target iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:07:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'name': 'rCsYcqle'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] initialize_connection for 44f3cbc9-fd81-4185-aa74-0896739af983 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:07:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 201, 'error': None, 'data': {'name': 'PhzIAFeq'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rCsYcqle', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '5118fd99-eb33-477a-930f-88dcb6f3179f'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:07:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] initialize_connection for f9476602-ab81-47c8-aa31-ecc8e3c672ee 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:07:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhzIAFeq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'e108a1db-4cd6-4bc4-9856-cab7507514d9'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:07:00 user cinder-volume[73403]: INFO cinder.volume.manager [req-8c16f637-7eb1-4f78-9a98-2ac42b219ca2 req-39c22e98-6f0e-46e0-8d71-df79bc4cbbcc tempest-ServerActionsTestJSON-1848627478 None] attachment_update completed successfully. Apr 14 03:07:00 user cinder-volume[73403]: INFO cinder.volume.manager [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-bf13995b-a8b7-4225-91e4-7fc013b23014 tempest-TaggedBootDevicesTest_v242-641324897 None] attachment_update completed successfully. Apr 14 03:07:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] create export for volume: e178f132-e302-4ee5-8ca6-45972e24754a. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:07:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] ensure volume e178f132-e302-4ee5-8ca6-45972e24754a assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:07:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] check if targe iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:07:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] create target and attach volume e178f132-e302-4ee5-8ca6-45972e24754a to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:07:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] create target iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:07:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:07:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:07:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:07:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] atach volume v_e178f132-e302-4ee5-8ca6-45972e24754a to target iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:07:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276159488', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:07:03 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.coordination [None req-1d582f3e-0b0f-4983-8d15-0a8b8d4fa2a1 tempest-TestVolumeBootPattern-910285030 None] Acquiring lock "cinder-f78b3968-f436-44d2-8fb3-4f3d899eeed5-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.coordination [None req-1d582f3e-0b0f-4983-8d15-0a8b8d4fa2a1 tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-f78b3968-f436-44d2-8fb3-4f3d899eeed5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d582f3e-0b0f-4983-8d15-0a8b8d4fa2a1 tempest-TestVolumeBootPattern-910285030 None] deleating snapshot s_f78b3968-f436-44d2-8fb3-4f3d899eeed5. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d582f3e-0b0f-4983-8d15-0a8b8d4fa2a1 tempest-TestVolumeBootPattern-910285030 None] get snapshots for volume s_f78b3968-f436-44d2-8fb3-4f3d899eeed5 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d582f3e-0b0f-4983-8d15-0a8b8d4fa2a1 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d582f3e-0b0f-4983-8d15-0a8b8d4fa2a1 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6536346338343035', 'lun': 0, 'mode': 'wt', 'name': 'v_e178f132-e302-4ee5-8ca6-45972e24754a', 'prod_id': 'Storage', 'scsi_id': 'e64c8405d15f46cb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] add credentails to target iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 201, 'error': None, 'data': {'name': 'akyODBJC'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] initialize_connection for e178f132-e302-4ee5-8ca6-45972e24754a 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akyODBJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'a8bb7005-4faf-4c15-926a-3d8c0ef7af87'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d582f3e-0b0f-4983-8d15-0a8b8d4fa2a1 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d582f3e-0b0f-4983-8d15-0a8b8d4fa2a1 tempest-TestVolumeBootPattern-910285030 None] get volume s_f78b3968-f436-44d2-8fb3-4f3d899eeed5 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d582f3e-0b0f-4983-8d15-0a8b8d4fa2a1 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d582f3e-0b0f-4983-8d15-0a8b8d4fa2a1 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:05 user cinder-volume[73403]: INFO cinder.volume.manager [req-f19b7c04-aa39-4c1a-bb81-db34f9afb584 req-9ac2c40b-73ff-45e6-b677-2c27f2e02df4 tempest-TaggedBootDevicesTest_v242-641324897 None] attachment_update completed successfully. Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d582f3e-0b0f-4983-8d15-0a8b8d4fa2a1 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_37bd0d93-b922-426c-8986-d86e886da69e@s_f78b3968-f436-44d2-8fb3-4f3d899eeed5', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442871', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26103808', 'sharesmb': None, 'createtxg': '112934', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17617052792690245359', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '29a96585cc35f1d8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276159488', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '85784', 'name': 's_f78b3968-f436-44d2-8fb3-4f3d899eeed5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '43593728', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d582f3e-0b0f-4983-8d15-0a8b8d4fa2a1 tempest-TestVolumeBootPattern-910285030 None] delete snapshot s_f78b3968-f436-44d2-8fb3-4f3d899eeed5 of volume v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d582f3e-0b0f-4983-8d15-0a8b8d4fa2a1 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bd0d93-b922-426c-8986-d86e886da69e/snapshots/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d582f3e-0b0f-4983-8d15-0a8b8d4fa2a1 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bd0d93-b922-426c-8986-d86e886da69e/snapshots/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d582f3e-0b0f-4983-8d15-0a8b8d4fa2a1 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bd0d93-b922-426c-8986-d86e886da69e/snapshots/s_f78b3968-f436-44d2-8fb3-4f3d899eeed5 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d582f3e-0b0f-4983-8d15-0a8b8d4fa2a1 tempest-TestVolumeBootPattern-910285030 None] snapshot s_f78b3968-f436-44d2-8fb3-4f3d899eeed5 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:07:07 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=71,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:07 user cinder-volume[73403]: DEBUG cinder.quota [None req-1d582f3e-0b0f-4983-8d15-0a8b8d4fa2a1 tempest-TestVolumeBootPattern-910285030 None] Created reservations ['3cd98137-7604-4a4e-a4af-3d317c49441f', '217998b6-5d9c-43d3-ab31-a5beadae53ff', '9d9444da-e453-4f1a-8ce4-642ed08243ee', '227daa1e-9b8b-4c24-b59d-fb263d1134bb'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:07:07 user cinder-volume[73403]: INFO cinder.volume.manager [None req-1d582f3e-0b0f-4983-8d15-0a8b8d4fa2a1 tempest-TestVolumeBootPattern-910285030 None] Delete snapshot completed successfully. Apr 14 03:07:07 user cinder-volume[73403]: DEBUG cinder.coordination [None req-1d582f3e-0b0f-4983-8d15-0a8b8d4fa2a1 tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-f78b3968-f436-44d2-8fb3-4f3d899eeed5-delete_snapshot" released by "delete_snapshot" :: held 2.298s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:07:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-b1dd9717-f81b-4fea-a927-b9467c68df40 tempest-TestVolumeBootPattern-910285030 None] terminate connection for 37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:07:10 user cinder-volume[73403]: INFO cinder.volume.manager [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-b1dd9717-f81b-4fea-a927-b9467c68df40 tempest-TestVolumeBootPattern-910285030 None] Terminate volume connection completed successfully. Apr 14 03:07:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-b1dd9717-f81b-4fea-a927-b9467c68df40 tempest-TestVolumeBootPattern-910285030 None] Deleting attachment 1b28a89d-4544-49fc-afc0-487d95abdf46. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:07:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-b1dd9717-f81b-4fea-a927-b9467c68df40 tempest-TestVolumeBootPattern-910285030 None] remove_export for volume: 37bd0d93-b922-426c-8986-d86e886da69e. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:07:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-b1dd9717-f81b-4fea-a927-b9467c68df40 tempest-TestVolumeBootPattern-910285030 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:07:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-b1dd9717-f81b-4fea-a927-b9467c68df40 tempest-TestVolumeBootPattern-910285030 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1010389850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=37bd0d93-b922-426c-8986-d86e886da69e,launched_at=2023-04-14T03:02:28Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='2d2e49e8e92e416faebf55e3d4e0e087',provider_auth='CHAP YcTtkeKx saXyl5TrFQx4CJ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:02:25Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:02:36Z,use_quota=True,user_id='60e11b7ab2914209b23bf7a53791da64',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:07:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-b1dd9717-f81b-4fea-a927-b9467c68df40 tempest-TestVolumeBootPattern-910285030 None] detach volume v_37bd0d93-b922-426c-8986-d86e886da69e from target iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:07:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-b1dd9717-f81b-4fea-a927-b9467c68df40 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e/luns/v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-b1dd9717-f81b-4fea-a927-b9467c68df40 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e/luns/v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-b1dd9717-f81b-4fea-a927-b9467c68df40 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e/luns/v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-b1dd9717-f81b-4fea-a927-b9467c68df40 tempest-TestVolumeBootPattern-910285030 None] delete target: iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-b1dd9717-f81b-4fea-a927-b9467c68df40 tempest-TestVolumeBootPattern-910285030 None] delete target iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-b1dd9717-f81b-4fea-a927-b9467c68df40 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-b1dd9717-f81b-4fea-a927-b9467c68df40 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-b1dd9717-f81b-4fea-a927-b9467c68df40 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-b1dd9717-f81b-4fea-a927-b9467c68df40 tempest-TestVolumeBootPattern-910285030 None] target iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.coordination [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Acquiring lock "cinder-37bd0d93-b922-426c-8986-d86e886da69e-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.coordination [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-37bd0d93-b922-426c-8986-d86e886da69e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] remove_export for volume: 37bd0d93-b922-426c-8986-d86e886da69e. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1010389850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=37bd0d93-b922-426c-8986-d86e886da69e,launched_at=2023-04-14T03:02:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2e49e8e92e416faebf55e3d4e0e087',provider_auth='CHAP YcTtkeKx saXyl5TrFQx4CJ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:02:25Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:07:12Z,updated_at=2023-04-14T03:07:12Z,use_quota=True,user_id='60e11b7ab2914209b23bf7a53791da64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] detach volume v_37bd0d93-b922-426c-8986-d86e886da69e from target iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e/luns/v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e/luns/v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e/luns/v_37bd0d93-b922-426c-8986-d86e886da69e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e/luns/v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] failed to remove resource iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e because of JDSS resource v_37bd0d93-b922-426c-8986-d86e886da69e DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] delete target: iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] delete target iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] failed to remove resource iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e because of JDSS resource iqn.2010-10.org.openstack:37bd0d93-b922-426c-8986-d86e886da69e DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] deleating volume v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] get snapshots for volume v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bd0d93-b922-426c-8986-d86e886da69e/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bd0d93-b922-426c-8986-d86e886da69e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bd0d93-b922-426c-8986-d86e886da69e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] get volume v_37bd0d93-b922-426c-8986-d86e886da69e info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:07:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_37bd0d93-b922-426c-8986-d86e886da69e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_37bd0d93-b922-426c-8986-d86e886da69e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442756', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26103808', 'sharesmb': None, 'createtxg': '112852', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9827443638577524303', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10125312', 'logicalused': '25899008', 'compressratio': '2.57', 'rootcontext': 'none', 'default_scsi_id': '7601ba8b39e55d04', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276204544', 'san:volume_id': '7601ba8b39e55d04f4b2614db6970c7ef1bfa521', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10125312', 'objsetid': '84043', 'name': 'v_37bd0d93-b922-426c-8986-d86e886da69e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10125312', 'logicalreferenced': '43593728', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] delete snapshot v_37bd0d93-b922-426c-8986-d86e886da69e of volume v_482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:07:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_37bd0d93-b922-426c-8986-d86e886da69e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] snapshot v_37bd0d93-b922-426c-8986-d86e886da69e deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.coordination [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Acquiring lock "cinder-edd92bd4-26a2-4652-bdc6-77805711142a-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.coordination [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Lock "cinder-edd92bd4-26a2-4652-bdc6-77805711142a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.quota [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Created reservations ['39d10045-aaf7-4eeb-b847-549d1b54f5c0', 'c43f0b67-648e-4607-837f-835f1d16a09a', 'fcf53bae-dc7b-4972-bbd7-4785fcb699d8', 'c797a915-8796-49a9-b5dd-22ed8a5a33a6'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] remove_export for volume: edd92bd4-26a2-4652-bdc6-77805711142a. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1947376354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=edd92bd4-26a2-4652-bdc6-77805711142a,launched_at=2023-04-14T02:59:23Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6371b4c05df843da9b134e12994c1d7a',provider_auth='CHAP kXtdrAGB PGoYaehFAzvdLM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:59:21Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:07:15Z,updated_at=2023-04-14T03:07:15Z,use_quota=True,user_id='337e2d8118324215b5a0baa36a5895b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] detach volume v_edd92bd4-26a2-4652-bdc6-77805711142a from target iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a/luns/v_edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a/luns/v_edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a/luns/v_edd92bd4-26a2-4652-bdc6-77805711142a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a/luns/v_edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] failed to remove resource iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a because of JDSS resource v_edd92bd4-26a2-4652-bdc6-77805711142a DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] delete target: iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] delete target iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] failed to remove resource iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a because of JDSS resource iqn.2010-10.org.openstack:edd92bd4-26a2-4652-bdc6-77805711142a DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] deleating volume v_edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] get snapshots for volume v_edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd92bd4-26a2-4652-bdc6-77805711142a/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd92bd4-26a2-4652-bdc6-77805711142a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd92bd4-26a2-4652-bdc6-77805711142a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] get volume v_edd92bd4-26a2-4652-bdc6-77805711142a info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:07:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_edd92bd4-26a2-4652-bdc6-77805711142a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442571', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '163840', 'sharesmb': None, 'createtxg': '112696', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2719390804363233680', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '163840', 'logicalused': '1630208', 'compressratio': '15.30', 'rootcontext': 'none', 'default_scsi_id': '0b9417cd4f99bcc2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114286415872', 'san:volume_id': '0b9417cd4f99bcc240f50a8f22cf5f04badccabe', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '15.30', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '163840', 'objsetid': '82283', 'name': 'v_edd92bd4-26a2-4652-bdc6-77805711142a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '163840', 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] delete volume:v_edd92bd4-26a2-4652-bdc6-77805711142a recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:07:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'available': '114286415872', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:07:15 user cinder-volume[73403]: DEBUG cinder.manager [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:15 user cinder-volume[73403]: INFO cinder.volume.manager [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Deleted volume successfully. Apr 14 03:07:15 user cinder-volume[73403]: DEBUG cinder.coordination [req-c672aa91-49fa-4708-ae02-e93e69b845f4 req-8ddfaada-74b8-4636-b802-2c77ef8e1f97 tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-37bd0d93-b922-426c-8986-d86e886da69e-delete_volume" released by "delete_volume" :: held 3.829s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:07:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_edd92bd4-26a2-4652-bdc6-77805711142a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] volume v_edd92bd4-26a2-4652-bdc6-77805711142a deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:07:17 user cinder-volume[73403]: DEBUG cinder.quota [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Created reservations ['b9660340-7b5d-488c-aa9b-eddf33b040fd', '0767a6f0-a089-4bbb-af6f-503b3e6249ec', '9dcad14e-e232-4a70-97f8-5884eb57272a', 'c2eb8896-cb40-4b96-b5be-de678627d715'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:07:17 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=67,cinder:UPDATE=24,cinder:INSERT=8,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:07:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:07:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Geting {'code': 200, 'error': None, 'data': {'available': '114286616576', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:07:18 user cinder-volume[73403]: DEBUG cinder.manager [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:18 user cinder-volume[73403]: INFO cinder.volume.manager [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Deleted volume successfully. Apr 14 03:07:18 user cinder-volume[73403]: DEBUG cinder.coordination [None req-fdc194e8-a3c7-4c57-bf4a-8b5119f54f58 tempest-TestStampPattern-323884970 None] Lock "cinder-edd92bd4-26a2-4652-bdc6-77805711142a-delete_volume" released by "delete_volume" :: held 3.571s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:07:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] create export for volume: 5106df68-dc27-4e16-9ea7-9c77a3d4ca23. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:07:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] ensure volume 5106df68-dc27-4e16-9ea7-9c77a3d4ca23 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:07:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] check if targe iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:07:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] create target and attach volume 5106df68-dc27-4e16-9ea7-9c77a3d4ca23 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:07:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] create target iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:07:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] atach volume v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 to target iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:07:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6430636332343165', 'lun': 0, 'mode': 'wt', 'name': 'v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23', 'prod_id': 'Storage', 'scsi_id': 'd0cc241e76b2bd93'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] add credentails to target iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:07:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] Geting {'code': 201, 'error': None, 'data': {'name': 'qSwoCLQN'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] initialize_connection for 5106df68-dc27-4e16-9ea7-9c77a3d4ca23 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:07:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSwoCLQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '2f658a02-7534-4f72-a836-304e187b4f8a'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:07:25 user cinder-volume[73403]: INFO cinder.volume.manager [req-b225a6ca-535b-4552-bead-7b02332b05ee req-131cc879-6937-48ec-85dd-9df7215b1781 tempest-TaggedAttachmentsTest-1835109148 None] attachment_update completed successfully. Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fb5db196-997f-4788-9f3f-be8b1c8eb506 req-814f4105-7a83-45ef-a44f-5e93e4690bbe tempest-TaggedAttachmentsTest-1835109148 None] terminate connection for 5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:07:29 user cinder-volume[73403]: INFO cinder.volume.manager [req-fb5db196-997f-4788-9f3f-be8b1c8eb506 req-814f4105-7a83-45ef-a44f-5e93e4690bbe tempest-TaggedAttachmentsTest-1835109148 None] Terminate volume connection completed successfully. Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-fb5db196-997f-4788-9f3f-be8b1c8eb506 req-814f4105-7a83-45ef-a44f-5e93e4690bbe tempest-TaggedAttachmentsTest-1835109148 None] Deleting attachment 2f658a02-7534-4f72-a836-304e187b4f8a. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fb5db196-997f-4788-9f3f-be8b1c8eb506 req-814f4105-7a83-45ef-a44f-5e93e4690bbe tempest-TaggedAttachmentsTest-1835109148 None] remove_export for volume: 5106df68-dc27-4e16-9ea7-9c77a3d4ca23. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fb5db196-997f-4788-9f3f-be8b1c8eb506 req-814f4105-7a83-45ef-a44f-5e93e4690bbe tempest-TaggedAttachmentsTest-1835109148 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fb5db196-997f-4788-9f3f-be8b1c8eb506 req-814f4105-7a83-45ef-a44f-5e93e4690bbe tempest-TaggedAttachmentsTest-1835109148 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-57962786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5106df68-dc27-4e16-9ea7-9c77a3d4ca23,launched_at=2023-04-14T03:05:20Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='6a991a4fd13b4a819b24479a341ba08c',provider_auth='CHAP qSwoCLQN 0CZW2d5UzBX9AR',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:05:19Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:07:28Z,use_quota=True,user_id='17999fdd4eb449d49d74b4de20f6614a',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fb5db196-997f-4788-9f3f-be8b1c8eb506 req-814f4105-7a83-45ef-a44f-5e93e4690bbe tempest-TaggedAttachmentsTest-1835109148 None] detach volume v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 from target iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fb5db196-997f-4788-9f3f-be8b1c8eb506 req-814f4105-7a83-45ef-a44f-5e93e4690bbe tempest-TaggedAttachmentsTest-1835109148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23/luns/v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fb5db196-997f-4788-9f3f-be8b1c8eb506 req-814f4105-7a83-45ef-a44f-5e93e4690bbe tempest-TaggedAttachmentsTest-1835109148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23/luns/v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fb5db196-997f-4788-9f3f-be8b1c8eb506 req-814f4105-7a83-45ef-a44f-5e93e4690bbe tempest-TaggedAttachmentsTest-1835109148 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23/luns/v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fb5db196-997f-4788-9f3f-be8b1c8eb506 req-814f4105-7a83-45ef-a44f-5e93e4690bbe tempest-TaggedAttachmentsTest-1835109148 None] delete target: iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fb5db196-997f-4788-9f3f-be8b1c8eb506 req-814f4105-7a83-45ef-a44f-5e93e4690bbe tempest-TaggedAttachmentsTest-1835109148 None] delete target iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fb5db196-997f-4788-9f3f-be8b1c8eb506 req-814f4105-7a83-45ef-a44f-5e93e4690bbe tempest-TaggedAttachmentsTest-1835109148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fb5db196-997f-4788-9f3f-be8b1c8eb506 req-814f4105-7a83-45ef-a44f-5e93e4690bbe tempest-TaggedAttachmentsTest-1835109148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Flow 'volume_create_manager' (6e045624-7cb5-4512-9d50-d93fa5151f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47648350-0866-4870-aabf-e96246df384e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47648350-0866-4870-aabf-e96246df384e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=17dfa3a0-9e76-403b-9d0d-8c75fc4959b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d004fc5d0f2044b89919e44767618d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:07:30Z,use_quota=True,user_id='a39b58106335427385b6adbc6eb8aeb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c32010-772b-4fb1-a775-28dfe2bd3d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c32010-772b-4fb1-a775-28dfe2bd3d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3384f7-2985-4090-917a-51035bb27c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3384f7-2985-4090-917a-51035bb27c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17dfa3a0-9e76-403b-9d0d-8c75fc4959b4', 'volume_name': 'volume-17dfa3a0-9e76-403b-9d0d-8c75fc4959b4', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f93c021-9830-4c86-8548-eb6604713ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f93c021-9830-4c86-8548-eb6604713ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa77bba-4a34-48a0-a5fa-d4093ca6f310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:29 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Volume 17dfa3a0-9e76-403b-9d0d-8c75fc4959b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17dfa3a0-9e76-403b-9d0d-8c75fc4959b4', 'volume_size': 1} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] creating volume v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] create volume {'name': 'v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fb5db196-997f-4788-9f3f-be8b1c8eb506 req-814f4105-7a83-45ef-a44f-5e93e4690bbe tempest-TaggedAttachmentsTest-1835109148 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fb5db196-997f-4788-9f3f-be8b1c8eb506 req-814f4105-7a83-45ef-a44f-5e93e4690bbe tempest-TaggedAttachmentsTest-1835109148 None] target iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:07:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4', 'is_clone': False, 'name': 'v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa77bba-4a34-48a0-a5fa-d4093ca6f310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17dfa3a0-9e76-403b-9d0d-8c75fc4959b4', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc4f174-db85-4eb1-aca6-734db8abbc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:31 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Volume volume-17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 (17dfa3a0-9e76-403b-9d0d-8c75fc4959b4): created successfully Apr 14 03:07:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc4f174-db85-4eb1-aca6-734db8abbc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Flow 'volume_create_manager' (6e045624-7cb5-4512-9d50-d93fa5151f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:07:31 user cinder-volume[73403]: INFO cinder.volume.manager [None req-91e81e77-e357-4c02-900e-b881821cf373 tempest-CinderUnicodeTest-61283878 None] Created volume successfully. Apr 14 03:07:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5d61ead-fb9a-4963-a595-45dace634481 tempest-BackendsCapabilitiesAdminTestsJSON-1765712511 None] Obtained capabilities list: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73403) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4784}} Apr 14 03:07:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1075d61b-1feb-4ec6-943d-e7b9f0fe4f79 tempest-BackendsCapabilitiesAdminTestsJSON-1765712511 None] Obtained capabilities list: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73403) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4784}} Apr 14 03:07:32 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:07:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Flow 'volume_create_manager' (171b7f52-baed-4351-9b23-ba956da19efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:07:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20ac48b3-40e5-438f-a31e-8f36e1084c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20ac48b3-40e5-438f-a31e-8f36e1084c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:07:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-885358577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=dd3346b2-663e-4edf-ba46-cc9eb23256b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d004fc5d0f2044b89919e44767618d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:07:32Z,use_quota=True,user_id='a39b58106335427385b6adbc6eb8aeb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e40a093c-fdce-4540-a49d-bf7e177dc9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e40a093c-fdce-4540-a49d-bf7e177dc9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443185ee-24fe-4e7c-a13b-73d990e1f772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443185ee-24fe-4e7c-a13b-73d990e1f772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd3346b2-663e-4edf-ba46-cc9eb23256b1', 'volume_name': 'volume-dd3346b2-663e-4edf-ba46-cc9eb23256b1', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891ae4ae-6307-4047-b198-50dd40237211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891ae4ae-6307-4047-b198-50dd40237211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75223b61-ed80-4927-8c8e-a2e326407f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:32 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Volume dd3346b2-663e-4edf-ba46-cc9eb23256b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd3346b2-663e-4edf-ba46-cc9eb23256b1', 'volume_size': 1} Apr 14 03:07:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] creating volume v_dd3346b2-663e-4edf-ba46-cc9eb23256b1. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:07:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] create volume {'name': 'v_dd3346b2-663e-4edf-ba46-cc9eb23256b1', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:07:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1', 'is_clone': False, 'name': 'v_dd3346b2-663e-4edf-ba46-cc9eb23256b1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:33 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75223b61-ed80-4927-8c8e-a2e326407f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd3346b2-663e-4edf-ba46-cc9eb23256b1', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:33 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acc287b-0321-47d7-937b-5d1a13ef4a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:33 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Volume volume-dd3346b2-663e-4edf-ba46-cc9eb23256b1 (dd3346b2-663e-4edf-ba46-cc9eb23256b1): created successfully Apr 14 03:07:33 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acc287b-0321-47d7-937b-5d1a13ef4a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:33 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Flow 'volume_create_manager' (171b7f52-baed-4351-9b23-ba956da19efe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:07:33 user cinder-volume[73403]: INFO cinder.volume.manager [None req-3d6f0e93-8382-4520-801b-04a1fa56aacd tempest-CinderUnicodeTest-61283878 None] Created volume successfully. Apr 14 03:07:35 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=66,cinder:INSERT=4,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33051efd-74d8-42c5-be9e-2af457502220 tempest-CinderUnicodeTest-61283878 None] create snapshot aa81dd1a-432d-4a96-a19c-807199a45d35 for volume dd3346b2-663e-4edf-ba46-cc9eb23256b1 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:07:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33051efd-74d8-42c5-be9e-2af457502220 tempest-CinderUnicodeTest-61283878 None] cloning v_dd3346b2-663e-4edf-ba46-cc9eb23256b1 to s_aa81dd1a-432d-4a96-a19c-807199a45d35 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:07:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33051efd-74d8-42c5-be9e-2af457502220 tempest-CinderUnicodeTest-61283878 None] create snapshot s_aa81dd1a-432d-4a96-a19c-807199a45d35 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:07:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33051efd-74d8-42c5-be9e-2af457502220 tempest-CinderUnicodeTest-61283878 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33051efd-74d8-42c5-be9e-2af457502220 tempest-CinderUnicodeTest-61283878 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33051efd-74d8-42c5-be9e-2af457502220 tempest-CinderUnicodeTest-61283878 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_aa81dd1a-432d-4a96-a19c-807199a45d35'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33051efd-74d8-42c5-be9e-2af457502220 tempest-CinderUnicodeTest-61283878 None] create volume s_aa81dd1a-432d-4a96-a19c-807199a45d35 from snapshot s_aa81dd1a-432d-4a96-a19c-807199a45d35 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:07:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33051efd-74d8-42c5-be9e-2af457502220 tempest-CinderUnicodeTest-61283878 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33051efd-74d8-42c5-be9e-2af457502220 tempest-CinderUnicodeTest-61283878 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33051efd-74d8-42c5-be9e-2af457502220 tempest-CinderUnicodeTest-61283878 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1@s_aa81dd1a-432d-4a96-a19c-807199a45d35', 'is_clone': True, 'full_name': 'Pool-0/s_aa81dd1a-432d-4a96-a19c-807199a45d35', 'name': 's_aa81dd1a-432d-4a96-a19c-807199a45d35'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33051efd-74d8-42c5-be9e-2af457502220 tempest-CinderUnicodeTest-61283878 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_aa81dd1a-432d-4a96-a19c-807199a45d35/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33051efd-74d8-42c5-be9e-2af457502220 tempest-CinderUnicodeTest-61283878 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_aa81dd1a-432d-4a96-a19c-807199a45d35/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33051efd-74d8-42c5-be9e-2af457502220 tempest-CinderUnicodeTest-61283878 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_aa81dd1a-432d-4a96-a19c-807199a45d35/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33051efd-74d8-42c5-be9e-2af457502220 tempest-CinderUnicodeTest-61283878 None] volume s_aa81dd1a-432d-4a96-a19c-807199a45d35 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:07:37 user cinder-volume[73403]: INFO cinder.volume.manager [None req-33051efd-74d8-42c5-be9e-2af457502220 tempest-CinderUnicodeTest-61283878 None] Create snapshot completed successfully Apr 14 03:07:38 user cinder-volume[73403]: DEBUG cinder.coordination [None req-6b2dd13c-0440-48cd-bbbe-4fd0dbb1bea8 tempest-CinderUnicodeTest-61283878 None] Acquiring lock "cinder-aa81dd1a-432d-4a96-a19c-807199a45d35-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:07:38 user cinder-volume[73403]: DEBUG cinder.coordination [None req-6b2dd13c-0440-48cd-bbbe-4fd0dbb1bea8 tempest-CinderUnicodeTest-61283878 None] Lock "cinder-aa81dd1a-432d-4a96-a19c-807199a45d35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:07:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b2dd13c-0440-48cd-bbbe-4fd0dbb1bea8 tempest-CinderUnicodeTest-61283878 None] deleating snapshot s_aa81dd1a-432d-4a96-a19c-807199a45d35. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:07:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b2dd13c-0440-48cd-bbbe-4fd0dbb1bea8 tempest-CinderUnicodeTest-61283878 None] get snapshots for volume s_aa81dd1a-432d-4a96-a19c-807199a45d35 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:07:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b2dd13c-0440-48cd-bbbe-4fd0dbb1bea8 tempest-CinderUnicodeTest-61283878 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_aa81dd1a-432d-4a96-a19c-807199a45d35/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b2dd13c-0440-48cd-bbbe-4fd0dbb1bea8 tempest-CinderUnicodeTest-61283878 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_aa81dd1a-432d-4a96-a19c-807199a45d35/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b2dd13c-0440-48cd-bbbe-4fd0dbb1bea8 tempest-CinderUnicodeTest-61283878 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_aa81dd1a-432d-4a96-a19c-807199a45d35/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b2dd13c-0440-48cd-bbbe-4fd0dbb1bea8 tempest-CinderUnicodeTest-61283878 None] get volume s_aa81dd1a-432d-4a96-a19c-807199a45d35 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:07:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b2dd13c-0440-48cd-bbbe-4fd0dbb1bea8 tempest-CinderUnicodeTest-61283878 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_aa81dd1a-432d-4a96-a19c-807199a45d35 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b2dd13c-0440-48cd-bbbe-4fd0dbb1bea8 tempest-CinderUnicodeTest-61283878 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_aa81dd1a-432d-4a96-a19c-807199a45d35 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b2dd13c-0440-48cd-bbbe-4fd0dbb1bea8 tempest-CinderUnicodeTest-61283878 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1@s_aa81dd1a-432d-4a96-a19c-807199a45d35', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_aa81dd1a-432d-4a96-a19c-807199a45d35', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443065', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113077', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3360705979881471655', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '17f46958adcc5887', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276290560', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86035', 'name': 's_aa81dd1a-432d-4a96-a19c-807199a45d35', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_aa81dd1a-432d-4a96-a19c-807199a45d35 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b2dd13c-0440-48cd-bbbe-4fd0dbb1bea8 tempest-CinderUnicodeTest-61283878 None] delete snapshot s_aa81dd1a-432d-4a96-a19c-807199a45d35 of volume v_dd3346b2-663e-4edf-ba46-cc9eb23256b1 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:07:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b2dd13c-0440-48cd-bbbe-4fd0dbb1bea8 tempest-CinderUnicodeTest-61283878 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1/snapshots/s_aa81dd1a-432d-4a96-a19c-807199a45d35 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b2dd13c-0440-48cd-bbbe-4fd0dbb1bea8 tempest-CinderUnicodeTest-61283878 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1/snapshots/s_aa81dd1a-432d-4a96-a19c-807199a45d35 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b2dd13c-0440-48cd-bbbe-4fd0dbb1bea8 tempest-CinderUnicodeTest-61283878 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1/snapshots/s_aa81dd1a-432d-4a96-a19c-807199a45d35 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b2dd13c-0440-48cd-bbbe-4fd0dbb1bea8 tempest-CinderUnicodeTest-61283878 None] snapshot s_aa81dd1a-432d-4a96-a19c-807199a45d35 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:07:40 user cinder-volume[73403]: DEBUG cinder.quota [None req-6b2dd13c-0440-48cd-bbbe-4fd0dbb1bea8 tempest-CinderUnicodeTest-61283878 None] Created reservations ['f41567ab-fce5-4026-a649-2a4918f4d46d', '7adf0adb-4ecf-441b-96fe-c29e765319ab', '43006034-b5c3-485f-8b96-b4f2a7967682', '7a9688a1-66d1-42b9-bf3e-4b6d2797a62f'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:07:40 user cinder-volume[73403]: INFO cinder.volume.manager [None req-6b2dd13c-0440-48cd-bbbe-4fd0dbb1bea8 tempest-CinderUnicodeTest-61283878 None] Delete snapshot completed successfully. Apr 14 03:07:40 user cinder-volume[73403]: DEBUG cinder.coordination [None req-6b2dd13c-0440-48cd-bbbe-4fd0dbb1bea8 tempest-CinderUnicodeTest-61283878 None] Lock "cinder-aa81dd1a-432d-4a96-a19c-807199a45d35-delete_snapshot" released by "delete_snapshot" :: held 2.229s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Acquiring lock "cinder-dd3346b2-663e-4edf-ba46-cc9eb23256b1-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Lock "cinder-dd3346b2-663e-4edf-ba46-cc9eb23256b1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] remove_export for volume: dd3346b2-663e-4edf-ba46-cc9eb23256b1. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:07:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-885358577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=dd3346b2-663e-4edf-ba46-cc9eb23256b1,launched_at=2023-04-14T03:07:34Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d004fc5d0f2044b89919e44767618d48',provider_auth='CHAP urtFOXES ZcDXOpq17ugI6i',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd3346b2-663e-4edf-ba46-cc9eb23256b1 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:07:32Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:07:41Z,updated_at=2023-04-14T03:07:41Z,use_quota=True,user_id='a39b58106335427385b6adbc6eb8aeb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:dd3346b2-663e-4edf-ba46-cc9eb23256b1. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] detach volume v_dd3346b2-663e-4edf-ba46-cc9eb23256b1 from target iqn.2010-10.org.openstack:dd3346b2-663e-4edf-ba46-cc9eb23256b1 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dd3346b2-663e-4edf-ba46-cc9eb23256b1/luns/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dd3346b2-663e-4edf-ba46-cc9eb23256b1/luns/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:dd3346b2-663e-4edf-ba46-cc9eb23256b1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dd3346b2-663e-4edf-ba46-cc9eb23256b1/luns/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dd3346b2-663e-4edf-ba46-cc9eb23256b1/luns/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] failed to remove resource iqn.2010-10.org.openstack:dd3346b2-663e-4edf-ba46-cc9eb23256b1 because of JDSS resource v_dd3346b2-663e-4edf-ba46-cc9eb23256b1 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] delete target: iqn.2010-10.org.openstack:dd3346b2-663e-4edf-ba46-cc9eb23256b1 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] delete target iqn.2010-10.org.openstack:dd3346b2-663e-4edf-ba46-cc9eb23256b1 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dd3346b2-663e-4edf-ba46-cc9eb23256b1 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dd3346b2-663e-4edf-ba46-cc9eb23256b1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:dd3346b2-663e-4edf-ba46-cc9eb23256b1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dd3346b2-663e-4edf-ba46-cc9eb23256b1'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:dd3346b2-663e-4edf-ba46-cc9eb23256b1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] failed to remove resource iqn.2010-10.org.openstack:dd3346b2-663e-4edf-ba46-cc9eb23256b1 because of JDSS resource iqn.2010-10.org.openstack:dd3346b2-663e-4edf-ba46-cc9eb23256b1 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] deleating volume v_dd3346b2-663e-4edf-ba46-cc9eb23256b1 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] get snapshots for volume v_dd3346b2-663e-4edf-ba46-cc9eb23256b1 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] get volume v_dd3346b2-663e-4edf-ba46-cc9eb23256b1 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443062', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113071', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4277519069072870409', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0040b3d6ebbf077b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276302848', 'san:volume_id': '0040b3d6ebbf077bab74099af421d002c82d9ba0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85831', 'name': 'v_dd3346b2-663e-4edf-ba46-cc9eb23256b1', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] delete volume:v_dd3346b2-663e-4edf-ba46-cc9eb23256b1 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Flow 'volume_create_manager' (ce1a9286-4920-478a-990f-72beefc50fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8897200-ecef-4f53-aef3-efe0d1605ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_dd3346b2-663e-4edf-ba46-cc9eb23256b1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] volume v_dd3346b2-663e-4edf-ba46-cc9eb23256b1 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8897200-ecef-4f53-aef3-efe0d1605ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-135919488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8e418ff4-4810-42ad-a061-e0d48cc141b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd9b54b35a04c8bacccc58910567e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:07:44Z,use_quota=True,user_id='29ebdc4a8068405ba4e72acb3c0d910d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00110b35-8fc8-441e-9f84-2354d3a3d09d),volume_type_id=00110b35-8fc8-441e-9f84-2354d3a3d09d)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10062745-badb-4e99-848f-300d1ab9b777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10062745-badb-4e99-848f-300d1ab9b777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b3503a-907a-4196-835e-bbe3017bfb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b3503a-907a-4196-835e-bbe3017bfb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e418ff4-4810-42ad-a061-e0d48cc141b9', 'volume_name': 'volume-8e418ff4-4810-42ad-a061-e0d48cc141b9', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b010a67d-4e78-4619-a840-c25299e17a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b010a67d-4e78-4619-a840-c25299e17a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c9e756-20b4-4602-b5aa-a99f4860bcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:44 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Volume 8e418ff4-4810-42ad-a061-e0d48cc141b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e418ff4-4810-42ad-a061-e0d48cc141b9', 'volume_size': 1} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] creating volume v_8e418ff4-4810-42ad-a061-e0d48cc141b9. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] create volume {'name': 'v_8e418ff4-4810-42ad-a061-e0d48cc141b9', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.quota [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Created reservations ['3f14b649-8ce5-41cc-9142-9c3144e2c466', '21f257bc-fa68-4371-818d-5a1bef2ff347', '2c3c89a0-edb1-4ea0-b640-0948d77af6d5', '51e2fbce-605b-4261-991d-cf7868cac681'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.coordination [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Acquiring lock "cinder-17dfa3a0-9e76-403b-9d0d-8c75fc4959b4-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.coordination [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Lock "cinder-17dfa3a0-9e76-403b-9d0d-8c75fc4959b4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] remove_export for volume: 17dfa3a0-9e76-403b-9d0d-8c75fc4959b4. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=17dfa3a0-9e76-403b-9d0d-8c75fc4959b4,launched_at=2023-04-14T03:07:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d004fc5d0f2044b89919e44767618d48',provider_auth='CHAP QnWlRbIH 5WD4aotFdegijH',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:07:30Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:07:45Z,updated_at=2023-04-14T03:07:45Z,use_quota=True,user_id='a39b58106335427385b6adbc6eb8aeb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:17dfa3a0-9e76-403b-9d0d-8c75fc4959b4. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] detach volume v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 from target iqn.2010-10.org.openstack:17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17dfa3a0-9e76-403b-9d0d-8c75fc4959b4/luns/v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17dfa3a0-9e76-403b-9d0d-8c75fc4959b4/luns/v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17dfa3a0-9e76-403b-9d0d-8c75fc4959b4/luns/v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17dfa3a0-9e76-403b-9d0d-8c75fc4959b4/luns/v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] failed to remove resource iqn.2010-10.org.openstack:17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 because of JDSS resource v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] delete target: iqn.2010-10.org.openstack:17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] delete target iqn.2010-10.org.openstack:17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17dfa3a0-9e76-403b-9d0d-8c75fc4959b4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] failed to remove resource iqn.2010-10.org.openstack:17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 because of JDSS resource iqn.2010-10.org.openstack:17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] deleating volume v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] get snapshots for volume v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276368384', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.manager [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:44 user cinder-volume[73403]: INFO cinder.volume.manager [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Deleted volume successfully. Apr 14 03:07:44 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c454b68d-1fd0-4fb2-bc35-97cd90d9c014 tempest-CinderUnicodeTest-61283878 None] Lock "cinder-dd3346b2-663e-4edf-ba46-cc9eb23256b1-delete_volume" released by "delete_volume" :: held 3.586s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:07:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] get volume v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:07:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443059', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113066', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10374290346830736975', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'da91cd627b3993e4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276298752', 'san:volume_id': 'da91cd627b3993e4ea8430f9e483113441ab1837', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85818', 'name': 'v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] delete volume:v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:07:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_8e418ff4-4810-42ad-a061-e0d48cc141b9', 'is_clone': False, 'name': 'v_8e418ff4-4810-42ad-a061-e0d48cc141b9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c9e756-20b4-4602-b5aa-a99f4860bcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e418ff4-4810-42ad-a061-e0d48cc141b9', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9302526b-addc-429e-9093-8ea8ca5561ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:45 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Volume volume-8e418ff4-4810-42ad-a061-e0d48cc141b9 (8e418ff4-4810-42ad-a061-e0d48cc141b9): created successfully Apr 14 03:07:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9302526b-addc-429e-9093-8ea8ca5561ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Flow 'volume_create_manager' (ce1a9286-4920-478a-990f-72beefc50fb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:07:45 user cinder-volume[73403]: INFO cinder.volume.manager [None req-7caef4a2-6841-4990-aa9b-e9d26e46126d tempest-VolumeTypesAccessTest-789854251 None] Created volume successfully. Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.coordination [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Acquiring lock "cinder-8e418ff4-4810-42ad-a061-e0d48cc141b9-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.coordination [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Lock "cinder-8e418ff4-4810-42ad-a061-e0d48cc141b9-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] remove_export for volume: 8e418ff4-4810-42ad-a061-e0d48cc141b9. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-135919488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8e418ff4-4810-42ad-a061-e0d48cc141b9,launched_at=2023-04-14T03:07:45Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd9b54b35a04c8bacccc58910567e0f',provider_auth='CHAP VEsZRdOo JwNORTid8meGD7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e418ff4-4810-42ad-a061-e0d48cc141b9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:07:44Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:07:46Z,updated_at=2023-04-14T03:07:46Z,use_quota=True,user_id='29ebdc4a8068405ba4e72acb3c0d910d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00110b35-8fc8-441e-9f84-2354d3a3d09d),volume_type_id=00110b35-8fc8-441e-9f84-2354d3a3d09d) from target:iqn.2010-10.org.openstack:8e418ff4-4810-42ad-a061-e0d48cc141b9. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] detach volume v_8e418ff4-4810-42ad-a061-e0d48cc141b9 from target iqn.2010-10.org.openstack:8e418ff4-4810-42ad-a061-e0d48cc141b9 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e418ff4-4810-42ad-a061-e0d48cc141b9/luns/v_8e418ff4-4810-42ad-a061-e0d48cc141b9 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e418ff4-4810-42ad-a061-e0d48cc141b9/luns/v_8e418ff4-4810-42ad-a061-e0d48cc141b9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8e418ff4-4810-42ad-a061-e0d48cc141b9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e418ff4-4810-42ad-a061-e0d48cc141b9/luns/v_8e418ff4-4810-42ad-a061-e0d48cc141b9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e418ff4-4810-42ad-a061-e0d48cc141b9/luns/v_8e418ff4-4810-42ad-a061-e0d48cc141b9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] failed to remove resource iqn.2010-10.org.openstack:8e418ff4-4810-42ad-a061-e0d48cc141b9 because of JDSS resource v_8e418ff4-4810-42ad-a061-e0d48cc141b9 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] delete target: iqn.2010-10.org.openstack:8e418ff4-4810-42ad-a061-e0d48cc141b9 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] delete target iqn.2010-10.org.openstack:8e418ff4-4810-42ad-a061-e0d48cc141b9 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e418ff4-4810-42ad-a061-e0d48cc141b9 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e418ff4-4810-42ad-a061-e0d48cc141b9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8e418ff4-4810-42ad-a061-e0d48cc141b9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e418ff4-4810-42ad-a061-e0d48cc141b9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e418ff4-4810-42ad-a061-e0d48cc141b9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] failed to remove resource iqn.2010-10.org.openstack:8e418ff4-4810-42ad-a061-e0d48cc141b9 because of JDSS resource iqn.2010-10.org.openstack:8e418ff4-4810-42ad-a061-e0d48cc141b9 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] deleating volume v_8e418ff4-4810-42ad-a061-e0d48cc141b9 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] get snapshots for volume v_8e418ff4-4810-42ad-a061-e0d48cc141b9 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e418ff4-4810-42ad-a061-e0d48cc141b9/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e418ff4-4810-42ad-a061-e0d48cc141b9/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e418ff4-4810-42ad-a061-e0d48cc141b9/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] get volume v_8e418ff4-4810-42ad-a061-e0d48cc141b9 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e418ff4-4810-42ad-a061-e0d48cc141b9 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e418ff4-4810-42ad-a061-e0d48cc141b9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8e418ff4-4810-42ad-a061-e0d48cc141b9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443073', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113086', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2854299636500021182', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '37926b8120484ed8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276368384', 'san:volume_id': '37926b8120484ed8f199dc3fc48740702eddb82e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85596', 'name': 'v_8e418ff4-4810-42ad-a061-e0d48cc141b9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e418ff4-4810-42ad-a061-e0d48cc141b9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] delete volume:v_8e418ff4-4810-42ad-a061-e0d48cc141b9 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e418ff4-4810-42ad-a061-e0d48cc141b9 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e418ff4-4810-42ad-a061-e0d48cc141b9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] volume v_17dfa3a0-9e76-403b-9d0d-8c75fc4959b4 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:DELETE=3,cinder:SELECT=70,cinder:UPDATE=23,cinder:INSERT=4 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.quota [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Created reservations ['43a08a1b-0a50-424f-b163-9a90b93db5cc', 'a2166ca2-5d76-4554-9324-d6ee4f01ee9f', 'fb85c590-37f2-409e-a948-61d7dd2547a8', '2a3e99dc-22eb-4202-9a04-cab308f0643f'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276368384', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:07:47 user cinder-volume[73403]: DEBUG cinder.manager [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:47 user cinder-volume[73403]: INFO cinder.volume.manager [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Deleted volume successfully. Apr 14 03:07:47 user cinder-volume[73403]: DEBUG cinder.coordination [None req-6fc660aa-8f06-4ac4-8709-0d11b986e3af tempest-CinderUnicodeTest-61283878 None] Lock "cinder-17dfa3a0-9e76-403b-9d0d-8c75fc4959b4-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:07:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e418ff4-4810-42ad-a061-e0d48cc141b9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] volume v_8e418ff4-4810-42ad-a061-e0d48cc141b9 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:07:49 user cinder-volume[73403]: WARNING cinder.quota [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-777421722 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-777421722, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:07:49 user cinder-volume[73403]: WARNING cinder.quota [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-777421722 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-777421722, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:07:49 user cinder-volume[73403]: DEBUG cinder.quota [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Created reservations ['71fe26b4-26f8-49b2-b60b-9245b522171d', '7dced2e7-31d5-4065-bd4a-4e97f58b5cdb', '014d09c4-cd46-400d-81b5-0d615d088c65', 'd111bb8e-192c-4f04-a540-dd774993ef31'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:07:49 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=51,cinder:INSERT=10,cinder:UPDATE=37,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:07:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:07:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:07:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276450304', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:07:49 user cinder-volume[73403]: DEBUG cinder.manager [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:49 user cinder-volume[73403]: INFO cinder.volume.manager [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Deleted volume successfully. Apr 14 03:07:50 user cinder-volume[73403]: DEBUG cinder.coordination [None req-eda4c461-8710-4dfc-91ef-812ce43da7a5 tempest-VolumeTypesAccessTest-789854251 None] Lock "cinder-8e418ff4-4810-42ad-a061-e0d48cc141b9-delete_volume" released by "delete_volume" :: held 3.751s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:07:53 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:07:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Flow 'volume_create_manager' (012602c6-a6e1-40ee-8561-cfbc9082f41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:07:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50dfa168-5be2-4841-a74c-53a01e285cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50dfa168-5be2-4841-a74c-53a01e285cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1088524657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e6232617-e61d-47af-a64b-041d3a45cb14,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cda4ef4c476f4899a2b1f31f68766252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:07:54Z,use_quota=True,user_id='b129e336dee14d379e7a451ff5140ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d114b144-a165-4b96-934d-58ce661e14de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d114b144-a165-4b96-934d-58ce661e14de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5633efad-0c96-4582-9130-3af8c15419f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5633efad-0c96-4582-9130-3af8c15419f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6232617-e61d-47af-a64b-041d3a45cb14', 'volume_name': 'volume-e6232617-e61d-47af-a64b-041d3a45cb14', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79b17b1-dd87-4a1a-b288-9024f40af624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79b17b1-dd87-4a1a-b288-9024f40af624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bca9415-34e4-497c-b75c-744d5c189e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:53 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Volume e6232617-e61d-47af-a64b-041d3a45cb14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6232617-e61d-47af-a64b-041d3a45cb14', 'volume_size': 1} Apr 14 03:07:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] creating volume v_e6232617-e61d-47af-a64b-041d3a45cb14. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:07:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] create volume {'name': 'v_e6232617-e61d-47af-a64b-041d3a45cb14', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:07:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e6232617-e61d-47af-a64b-041d3a45cb14', 'is_clone': False, 'name': 'v_e6232617-e61d-47af-a64b-041d3a45cb14'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bca9415-34e4-497c-b75c-744d5c189e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6232617-e61d-47af-a64b-041d3a45cb14', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c7f886-9f5c-4789-8f9e-03d574ea296f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:54 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Volume volume-e6232617-e61d-47af-a64b-041d3a45cb14 (e6232617-e61d-47af-a64b-041d3a45cb14): created successfully Apr 14 03:07:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c7f886-9f5c-4789-8f9e-03d574ea296f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Flow 'volume_create_manager' (012602c6-a6e1-40ee-8561-cfbc9082f41c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:07:54 user cinder-volume[73403]: INFO cinder.volume.manager [None req-5897f0bc-c8e9-46e0-97a2-729d208d5ade tempest-VolumesListTestJSON-1278687108 None] Created volume successfully. Apr 14 03:07:56 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:07:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Flow 'volume_create_manager' (2abda291-24f6-46bb-b995-d54673041a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:07:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4272d501-6ba2-4f10-bfc8-e2941330e196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4272d501-6ba2-4f10-bfc8-e2941330e196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2135187800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1de8ecad-0af2-485f-ae49-ac73b980812a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cda4ef4c476f4899a2b1f31f68766252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:07:56Z,use_quota=True,user_id='b129e336dee14d379e7a451ff5140ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c63ae4a-4302-4a07-b876-36a6afd3026b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c63ae4a-4302-4a07-b876-36a6afd3026b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68bd2c5c-0c76-43ea-ac27-fdf13a0ca2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68bd2c5c-0c76-43ea-ac27-fdf13a0ca2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1de8ecad-0af2-485f-ae49-ac73b980812a', 'volume_name': 'volume-1de8ecad-0af2-485f-ae49-ac73b980812a', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc5d712-894a-4510-9e8c-fa5043b77812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc5d712-894a-4510-9e8c-fa5043b77812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (672edca6-0c40-4cc0-819f-c273e06ce783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:56 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Volume 1de8ecad-0af2-485f-ae49-ac73b980812a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1de8ecad-0af2-485f-ae49-ac73b980812a', 'volume_size': 1} Apr 14 03:07:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] creating volume v_1de8ecad-0af2-485f-ae49-ac73b980812a. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:07:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] create volume {'name': 'v_1de8ecad-0af2-485f-ae49-ac73b980812a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:07:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_1de8ecad-0af2-485f-ae49-ac73b980812a', 'is_clone': False, 'name': 'v_1de8ecad-0af2-485f-ae49-ac73b980812a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (672edca6-0c40-4cc0-819f-c273e06ce783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1de8ecad-0af2-485f-ae49-ac73b980812a', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0cf020-3698-40ff-a6f5-fb98530bd320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:57 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Volume volume-1de8ecad-0af2-485f-ae49-ac73b980812a (1de8ecad-0af2-485f-ae49-ac73b980812a): created successfully Apr 14 03:07:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0cf020-3698-40ff-a6f5-fb98530bd320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Flow 'volume_create_manager' (2abda291-24f6-46bb-b995-d54673041a85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:07:57 user cinder-volume[73403]: INFO cinder.volume.manager [None req-1e9007d3-1ea8-4340-9d40-e4d840182827 tempest-VolumesListTestJSON-1278687108 None] Created volume successfully. Apr 14 03:07:57 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:07:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Flow 'volume_create_manager' (1c79ab77-9161-443d-b39b-21689c12c3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:07:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec8efbe6-c47d-4e35-9583-db9251147ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec8efbe6-c47d-4e35-9583-db9251147ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1400246140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=512ab9d1-40d2-4b7b-96a2-b319f11f426e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cda4ef4c476f4899a2b1f31f68766252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:07:57Z,use_quota=True,user_id='b129e336dee14d379e7a451ff5140ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f520caa9-f00d-4739-9227-5b5b7e8e8694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f520caa9-f00d-4739-9227-5b5b7e8e8694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2375a85-2ab7-46e5-b9aa-ca55bc895e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2375a85-2ab7-46e5-b9aa-ca55bc895e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '512ab9d1-40d2-4b7b-96a2-b319f11f426e', 'volume_name': 'volume-512ab9d1-40d2-4b7b-96a2-b319f11f426e', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b90e56b-e0c2-4994-a68f-4495ed3034cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b90e56b-e0c2-4994-a68f-4495ed3034cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28543c4e-db13-436c-964c-af15078dfcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:57 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Volume 512ab9d1-40d2-4b7b-96a2-b319f11f426e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-512ab9d1-40d2-4b7b-96a2-b319f11f426e', 'volume_size': 1} Apr 14 03:07:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] creating volume v_512ab9d1-40d2-4b7b-96a2-b319f11f426e. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:07:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] create volume {'name': 'v_512ab9d1-40d2-4b7b-96a2-b319f11f426e', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:07:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:07:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_512ab9d1-40d2-4b7b-96a2-b319f11f426e', 'is_clone': False, 'name': 'v_512ab9d1-40d2-4b7b-96a2-b319f11f426e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:07:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28543c4e-db13-436c-964c-af15078dfcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-512ab9d1-40d2-4b7b-96a2-b319f11f426e', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ad656c-5d3c-47d1-8fdb-1dfeede871a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:58 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Volume volume-512ab9d1-40d2-4b7b-96a2-b319f11f426e (512ab9d1-40d2-4b7b-96a2-b319f11f426e): created successfully Apr 14 03:07:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ad656c-5d3c-47d1-8fdb-1dfeede871a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Flow 'volume_create_manager' (1c79ab77-9161-443d-b39b-21689c12c3f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:07:58 user cinder-volume[73403]: INFO cinder.volume.manager [None req-92e90e60-4d9e-47f3-a8eb-360fc92607c3 tempest-VolumesListTestJSON-1278687108 None] Created volume successfully. Apr 14 03:07:59 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:07:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Flow 'volume_create_manager' (28119ee6-6408-4d43-8601-8d4844a9b6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:07:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3afcb1-1129-43ee-addc-b2b6f0cd9aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3afcb1-1129-43ee-addc-b2b6f0cd9aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:07:59Z,deleted=False,deleted_at=None,display_description='',display_name='2692a422-82e6-4f3b-b91e-6a2ea28e4d0a-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0af4cdb2-c179-4459-8ef7-43518caaaf7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2c5b2aafaf4ca7bf62e988ac726658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:07:59Z,use_quota=True,user_id='d666936eb0ee43a2ad9e17a12e6e273d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6fce316-e565-4575-808c-658a03d62324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6fce316-e565-4575-808c-658a03d62324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95da5871-fbcd-4c72-84f1-11589c481aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95da5871-fbcd-4c72-84f1-11589c481aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0af4cdb2-c179-4459-8ef7-43518caaaf7c', 'volume_name': 'volume-0af4cdb2-c179-4459-8ef7-43518caaaf7c', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3d5bf3-7b9c-4fe7-b946-295a3b9fc871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3d5bf3-7b9c-4fe7-b946-295a3b9fc871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:07:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520b974f-8b54-4bb1-a5aa-96a1dd8e18a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:07:59 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Volume 0af4cdb2-c179-4459-8ef7-43518caaaf7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0af4cdb2-c179-4459-8ef7-43518caaaf7c', 'volume_size': 1} Apr 14 03:07:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] creating volume v_0af4cdb2-c179-4459-8ef7-43518caaaf7c. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:07:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] create volume {'name': 'v_0af4cdb2-c179-4459-8ef7-43518caaaf7c', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:07:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:07:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_0af4cdb2-c179-4459-8ef7-43518caaaf7c', 'is_clone': False, 'name': 'v_0af4cdb2-c179-4459-8ef7-43518caaaf7c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520b974f-8b54-4bb1-a5aa-96a1dd8e18a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0af4cdb2-c179-4459-8ef7-43518caaaf7c', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:08:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ead6c9-a804-48c8-86ce-032c21eef740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:08:00 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Volume volume-0af4cdb2-c179-4459-8ef7-43518caaaf7c (0af4cdb2-c179-4459-8ef7-43518caaaf7c): created successfully Apr 14 03:08:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ead6c9-a804-48c8-86ce-032c21eef740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:08:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Flow 'volume_create_manager' (28119ee6-6408-4d43-8601-8d4844a9b6e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:08:00 user cinder-volume[73403]: INFO cinder.volume.manager [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-1c65a699-953b-40f6-9a15-cc595f9ef1bf tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Created volume successfully. Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Flow 'volume_create_manager' (355f4bc6-38cf-4b04-83c6-4a094fc8b902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c79d353-b8bd-4833-9e84-54fc1aecc2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c79d353-b8bd-4833-9e84-54fc1aecc2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1818179131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c6fbfee2-70fa-477a-a761-8d092061e691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2e49e8e92e416faebf55e3d4e0e087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:08:01Z,use_quota=True,user_id='60e11b7ab2914209b23bf7a53791da64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e0731a4-70c3-451c-9a26-3d05cdefa930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e0731a4-70c3-451c-9a26-3d05cdefa930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a45bd0-eaac-4da1-921e-e89e125715ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a45bd0-eaac-4da1-921e-e89e125715ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c6fbfee2-70fa-477a-a761-8d092061e691', 'volume_name': 'volume-c6fbfee2-70fa-477a-a761-8d092061e691', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ac2195-b525-4fc3-9860-c81cb55ed756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ac2195-b525-4fc3-9860-c81cb55ed756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e3ea8d-5526-41b1-89f4-d34a916487dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:08:01 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Volume c6fbfee2-70fa-477a-a761-8d092061e691: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c6fbfee2-70fa-477a-a761-8d092061e691', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Cloning c6fbfee2-70fa-477a-a761-8d092061e691 from image 98e6a247-250b-4bb5-a947-e7f93598d16e at location (None, None). {{(pid=73403) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Acquiring lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" by "_prepare_image_cache_entry" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 3, 8, 1, 492155)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Found cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Attempting to retrieve cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 3, 8, 1, 507802)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Creating from source image-volume 482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] cloned volume 482f938f-083c-4221-99f8-3320a80b8725 to c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] cloning v_482f938f-083c-4221-99f8-3320a80b8725 to v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] create snapshot v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:02 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Acquiring lock "cinder-512ab9d1-40d2-4b7b-96a2-b319f11f426e-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:08:02 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Lock "cinder-512ab9d1-40d2-4b7b-96a2-b319f11f426e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:08:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] remove_export for volume: 512ab9d1-40d2-4b7b-96a2-b319f11f426e. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:08:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:08:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1400246140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=512ab9d1-40d2-4b7b-96a2-b319f11f426e,launched_at=2023-04-14T03:07:59Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cda4ef4c476f4899a2b1f31f68766252',provider_auth='CHAP tHkhCerG g5d2moZ07yuhXM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:512ab9d1-40d2-4b7b-96a2-b319f11f426e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:07:57Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:08:02Z,updated_at=2023-04-14T03:08:02Z,use_quota=True,user_id='b129e336dee14d379e7a451ff5140ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:512ab9d1-40d2-4b7b-96a2-b319f11f426e. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:08:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] detach volume v_512ab9d1-40d2-4b7b-96a2-b319f11f426e from target iqn.2010-10.org.openstack:512ab9d1-40d2-4b7b-96a2-b319f11f426e {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:08:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:512ab9d1-40d2-4b7b-96a2-b319f11f426e/luns/v_512ab9d1-40d2-4b7b-96a2-b319f11f426e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:512ab9d1-40d2-4b7b-96a2-b319f11f426e/luns/v_512ab9d1-40d2-4b7b-96a2-b319f11f426e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_c6fbfee2-70fa-477a-a761-8d092061e691'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] create volume v_c6fbfee2-70fa-477a-a761-8d092061e691 from snapshot v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:08:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:512ab9d1-40d2-4b7b-96a2-b319f11f426e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:512ab9d1-40d2-4b7b-96a2-b319f11f426e/luns/v_512ab9d1-40d2-4b7b-96a2-b319f11f426e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:512ab9d1-40d2-4b7b-96a2-b319f11f426e/luns/v_512ab9d1-40d2-4b7b-96a2-b319f11f426e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] failed to remove resource iqn.2010-10.org.openstack:512ab9d1-40d2-4b7b-96a2-b319f11f426e because of JDSS resource v_512ab9d1-40d2-4b7b-96a2-b319f11f426e DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:08:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] delete target: iqn.2010-10.org.openstack:512ab9d1-40d2-4b7b-96a2-b319f11f426e {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:08:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] delete target iqn.2010-10.org.openstack:512ab9d1-40d2-4b7b-96a2-b319f11f426e {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:08:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:512ab9d1-40d2-4b7b-96a2-b319f11f426e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:512ab9d1-40d2-4b7b-96a2-b319f11f426e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_c6fbfee2-70fa-477a-a761-8d092061e691', 'is_clone': True, 'full_name': 'Pool-0/v_c6fbfee2-70fa-477a-a761-8d092061e691', 'name': 'v_c6fbfee2-70fa-477a-a761-8d092061e691'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] get volume v_c6fbfee2-70fa-477a-a761-8d092061e691 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:512ab9d1-40d2-4b7b-96a2-b319f11f426e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:512ab9d1-40d2-4b7b-96a2-b319f11f426e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:512ab9d1-40d2-4b7b-96a2-b319f11f426e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] failed to remove resource iqn.2010-10.org.openstack:512ab9d1-40d2-4b7b-96a2-b319f11f426e because of JDSS resource iqn.2010-10.org.openstack:512ab9d1-40d2-4b7b-96a2-b319f11f426e DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] deleating volume v_512ab9d1-40d2-4b7b-96a2-b319f11f426e {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] get snapshots for volume v_512ab9d1-40d2-4b7b-96a2-b319f11f426e {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_512ab9d1-40d2-4b7b-96a2-b319f11f426e/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_512ab9d1-40d2-4b7b-96a2-b319f11f426e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_c6fbfee2-70fa-477a-a761-8d092061e691', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c6fbfee2-70fa-477a-a761-8d092061e691', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443091', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '113111', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2928358237745687671', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '432cad81504b77c1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276085760', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86165', 'name': 'v_c6fbfee2-70fa-477a-a761-8d092061e691', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Marking volume c6fbfee2-70fa-477a-a761-8d092061e691 as bootable. {{(pid=73403) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Copying metadata from image 98e6a247-250b-4bb5-a947-e7f93598d16e to c6fbfee2-70fa-477a-a761-8d092061e691. {{(pid=73403) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Creating volume glance metadata for volume c6fbfee2-70fa-477a-a761-8d092061e691 backed by image 98e6a247-250b-4bb5-a947-e7f93598d16e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73403) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e3ea8d-5526-41b1-89f4-d34a916487dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6fbfee2-70fa-477a-a761-8d092061e691', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5770fcca-1903-4ef0-a4fd-7b5c16d42b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:08:03 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Volume volume-c6fbfee2-70fa-477a-a761-8d092061e691 (c6fbfee2-70fa-477a-a761-8d092061e691): created successfully Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5770fcca-1903-4ef0-a4fd-7b5c16d42b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:08:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Flow 'volume_create_manager' (355f4bc6-38cf-4b04-83c6-4a094fc8b902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:08:03 user cinder-volume[73403]: INFO cinder.volume.manager [None req-f2542447-c94b-43d8-a9ec-e3ddd836f3a4 tempest-TestVolumeBootPattern-910285030 None] Created volume successfully. Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276085760', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_512ab9d1-40d2-4b7b-96a2-b319f11f426e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] get volume v_512ab9d1-40d2-4b7b-96a2-b319f11f426e info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_512ab9d1-40d2-4b7b-96a2-b319f11f426e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_512ab9d1-40d2-4b7b-96a2-b319f11f426e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_512ab9d1-40d2-4b7b-96a2-b319f11f426e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443087', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113101', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7640927844522506335', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd84545665b65d1db', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276073472', 'san:volume_id': 'd84545665b65d1db81494a95afefe9e85bfe7882', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85681', 'name': 'v_512ab9d1-40d2-4b7b-96a2-b319f11f426e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_512ab9d1-40d2-4b7b-96a2-b319f11f426e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] delete volume:v_512ab9d1-40d2-4b7b-96a2-b319f11f426e recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_512ab9d1-40d2-4b7b-96a2-b319f11f426e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_512ab9d1-40d2-4b7b-96a2-b319f11f426e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] create export for volume: 0af4cdb2-c179-4459-8ef7-43518caaaf7c. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] ensure volume 0af4cdb2-c179-4459-8ef7-43518caaaf7c assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] check if targe iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] create target and attach volume 0af4cdb2-c179-4459-8ef7-43518caaaf7c to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] create target iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_512ab9d1-40d2-4b7b-96a2-b319f11f426e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] volume v_512ab9d1-40d2-4b7b-96a2-b319f11f426e deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:08:05 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=28,cinder:SELECT=59,cinder:DELETE=5,cinder:INSERT=8 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:08:05 user cinder-volume[73403]: DEBUG cinder.quota [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Created reservations ['3cad728e-6436-4d76-a27d-3e65734d3ca6', '7f68f1e7-6c3e-4c98-8c96-ab66c659116d', 'f4fa7e1b-4ba0-4bba-af4c-ff0444560919', 'dcf8ceda-0c08-4975-8045-34f8c2a6d12e'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.coordination [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Acquiring lock "cinder-1de8ecad-0af2-485f-ae49-ac73b980812a-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276143104', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.manager [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] create export for volume: c6fbfee2-70fa-477a-a761-8d092061e691. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] ensure volume c6fbfee2-70fa-477a-a761-8d092061e691 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] check if targe iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:06 user cinder-volume[73403]: INFO cinder.volume.manager [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Deleted volume successfully. Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.coordination [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Lock "cinder-1de8ecad-0af2-485f-ae49-ac73b980812a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f2f8afe4-d481-43a7-a2f9-d28fb8c619fb tempest-VolumesListTestJSON-1278687108 None] Lock "cinder-512ab9d1-40d2-4b7b-96a2-b319f11f426e-delete_volume" released by "delete_volume" :: held 4.507s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] create target and attach volume c6fbfee2-70fa-477a-a761-8d092061e691 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] create target iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] remove_export for volume: 1de8ecad-0af2-485f-ae49-ac73b980812a. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2135187800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1de8ecad-0af2-485f-ae49-ac73b980812a,launched_at=2023-04-14T03:07:57Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cda4ef4c476f4899a2b1f31f68766252',provider_auth='CHAP GLAIxRPt yruOo0EITxGX8Q',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de8ecad-0af2-485f-ae49-ac73b980812a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:07:56Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:08:07Z,updated_at=2023-04-14T03:08:07Z,use_quota=True,user_id='b129e336dee14d379e7a451ff5140ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:1de8ecad-0af2-485f-ae49-ac73b980812a. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] detach volume v_1de8ecad-0af2-485f-ae49-ac73b980812a from target iqn.2010-10.org.openstack:1de8ecad-0af2-485f-ae49-ac73b980812a {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1de8ecad-0af2-485f-ae49-ac73b980812a/luns/v_1de8ecad-0af2-485f-ae49-ac73b980812a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1de8ecad-0af2-485f-ae49-ac73b980812a/luns/v_1de8ecad-0af2-485f-ae49-ac73b980812a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] atach volume v_0af4cdb2-c179-4459-8ef7-43518caaaf7c to target iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:08:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3966373662313666', 'lun': 0, 'mode': 'wt', 'name': 'v_0af4cdb2-c179-4459-8ef7-43518caaaf7c', 'prod_id': 'Storage', 'scsi_id': '9f76b16f5f0bd53f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] add credentails to target iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:08:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Geting {'code': 201, 'error': None, 'data': {'name': 'kMFlEcQj'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] initialize_connection for 0af4cdb2-c179-4459-8ef7-43518caaaf7c 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:08:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kMFlEcQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '54363199-122c-4acb-8e4a-9a1e390c992e'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:08:09 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=66,cinder:UPDATE=21,cinder:DELETE=3,cinder:INSERT=10 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:08:09 user cinder-volume[73403]: INFO cinder.volume.manager [req-389ef989-72f9-4d4a-be54-d3c283d3f5aa req-37eaed8c-ebff-4aba-a0ec-c00541908185 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] attachment_update completed successfully. Apr 14 03:08:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] atach volume v_c6fbfee2-70fa-477a-a761-8d092061e691 to target iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:08:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1de8ecad-0af2-485f-ae49-ac73b980812a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1de8ecad-0af2-485f-ae49-ac73b980812a/luns/v_1de8ecad-0af2-485f-ae49-ac73b980812a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1de8ecad-0af2-485f-ae49-ac73b980812a/luns/v_1de8ecad-0af2-485f-ae49-ac73b980812a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] failed to remove resource iqn.2010-10.org.openstack:1de8ecad-0af2-485f-ae49-ac73b980812a because of JDSS resource v_1de8ecad-0af2-485f-ae49-ac73b980812a DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:08:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] delete target: iqn.2010-10.org.openstack:1de8ecad-0af2-485f-ae49-ac73b980812a {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:08:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] delete target iqn.2010-10.org.openstack:1de8ecad-0af2-485f-ae49-ac73b980812a {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:08:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1de8ecad-0af2-485f-ae49-ac73b980812a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1de8ecad-0af2-485f-ae49-ac73b980812a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3433326361643831', 'lun': 0, 'mode': 'wt', 'name': 'v_c6fbfee2-70fa-477a-a761-8d092061e691', 'prod_id': 'Storage', 'scsi_id': '432cad81504b77c1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] add credentails to target iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1de8ecad-0af2-485f-ae49-ac73b980812a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1de8ecad-0af2-485f-ae49-ac73b980812a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1de8ecad-0af2-485f-ae49-ac73b980812a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] failed to remove resource iqn.2010-10.org.openstack:1de8ecad-0af2-485f-ae49-ac73b980812a because of JDSS resource iqn.2010-10.org.openstack:1de8ecad-0af2-485f-ae49-ac73b980812a DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] deleating volume v_1de8ecad-0af2-485f-ae49-ac73b980812a {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] get snapshots for volume v_1de8ecad-0af2-485f-ae49-ac73b980812a {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1de8ecad-0af2-485f-ae49-ac73b980812a/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1de8ecad-0af2-485f-ae49-ac73b980812a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': {'name': 'tekamKoO'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] initialize_connection for c6fbfee2-70fa-477a-a761-8d092061e691 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tekamKoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'd90b3770-b8d3-4a03-8ecd-9841fb06a5f8'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:08:11 user cinder-volume[73403]: INFO cinder.volume.manager [req-185f7a07-56f5-4b21-a88c-e7b09596a2e6 req-2e993c14-e936-456a-b59c-c83ce2358199 tempest-TestVolumeBootPattern-910285030 None] attachment_update completed successfully. Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1de8ecad-0af2-485f-ae49-ac73b980812a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] get volume v_1de8ecad-0af2-485f-ae49-ac73b980812a info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1de8ecad-0af2-485f-ae49-ac73b980812a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1de8ecad-0af2-485f-ae49-ac73b980812a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1de8ecad-0af2-485f-ae49-ac73b980812a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443085', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113097', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8693500341868834982', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b51a172f9c92011d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276143104', 'san:volume_id': 'b51a172f9c92011dea6a4c9b8e9d16de34297b35', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85672', 'name': 'v_1de8ecad-0af2-485f-ae49-ac73b980812a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1de8ecad-0af2-485f-ae49-ac73b980812a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] delete volume:v_1de8ecad-0af2-485f-ae49-ac73b980812a recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1de8ecad-0af2-485f-ae49-ac73b980812a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1de8ecad-0af2-485f-ae49-ac73b980812a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1de8ecad-0af2-485f-ae49-ac73b980812a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] volume v_1de8ecad-0af2-485f-ae49-ac73b980812a deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:08:13 user cinder-volume[73403]: DEBUG cinder.quota [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Created reservations ['92a9906d-31bb-4b6a-9db7-7bd318c5ae03', '6e6a8d48-b298-46f0-ad40-a8089493a93c', 'f5b3e370-24b4-4550-9742-0232e1efb710', 'adc8ed4a-4249-4c7c-a2ae-692184b99c70'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:08:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:08:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:08:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.coordination [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Acquiring lock "cinder-e6232617-e61d-47af-a64b-041d3a45cb14-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.coordination [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Lock "cinder-e6232617-e61d-47af-a64b-041d3a45cb14-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276225024', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.manager [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:08:14 user cinder-volume[73403]: INFO cinder.volume.manager [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Deleted volume successfully. Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] remove_export for volume: e6232617-e61d-47af-a64b-041d3a45cb14. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1088524657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e6232617-e61d-47af-a64b-041d3a45cb14,launched_at=2023-04-14T03:07:55Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cda4ef4c476f4899a2b1f31f68766252',provider_auth='CHAP aMuDflEP 02CnbxUask6y8q',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6232617-e61d-47af-a64b-041d3a45cb14 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:07:54Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:08:14Z,updated_at=2023-04-14T03:08:14Z,use_quota=True,user_id='b129e336dee14d379e7a451ff5140ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:e6232617-e61d-47af-a64b-041d3a45cb14. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] detach volume v_e6232617-e61d-47af-a64b-041d3a45cb14 from target iqn.2010-10.org.openstack:e6232617-e61d-47af-a64b-041d3a45cb14 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e6232617-e61d-47af-a64b-041d3a45cb14/luns/v_e6232617-e61d-47af-a64b-041d3a45cb14 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e6232617-e61d-47af-a64b-041d3a45cb14/luns/v_e6232617-e61d-47af-a64b-041d3a45cb14 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.coordination [None req-684016c3-8f07-4b97-9b0b-7edf9d04b008 tempest-VolumesListTestJSON-1278687108 None] Lock "cinder-1de8ecad-0af2-485f-ae49-ac73b980812a-delete_volume" released by "delete_volume" :: held 7.709s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e6232617-e61d-47af-a64b-041d3a45cb14 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e6232617-e61d-47af-a64b-041d3a45cb14/luns/v_e6232617-e61d-47af-a64b-041d3a45cb14'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e6232617-e61d-47af-a64b-041d3a45cb14/luns/v_e6232617-e61d-47af-a64b-041d3a45cb14 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] failed to remove resource iqn.2010-10.org.openstack:e6232617-e61d-47af-a64b-041d3a45cb14 because of JDSS resource v_e6232617-e61d-47af-a64b-041d3a45cb14 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] delete target: iqn.2010-10.org.openstack:e6232617-e61d-47af-a64b-041d3a45cb14 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] delete target iqn.2010-10.org.openstack:e6232617-e61d-47af-a64b-041d3a45cb14 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e6232617-e61d-47af-a64b-041d3a45cb14 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e6232617-e61d-47af-a64b-041d3a45cb14 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e6232617-e61d-47af-a64b-041d3a45cb14 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e6232617-e61d-47af-a64b-041d3a45cb14'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e6232617-e61d-47af-a64b-041d3a45cb14 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] failed to remove resource iqn.2010-10.org.openstack:e6232617-e61d-47af-a64b-041d3a45cb14 because of JDSS resource iqn.2010-10.org.openstack:e6232617-e61d-47af-a64b-041d3a45cb14 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] deleating volume v_e6232617-e61d-47af-a64b-041d3a45cb14 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] get snapshots for volume v_e6232617-e61d-47af-a64b-041d3a45cb14 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e6232617-e61d-47af-a64b-041d3a45cb14/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e6232617-e61d-47af-a64b-041d3a45cb14/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e6232617-e61d-47af-a64b-041d3a45cb14/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] get volume v_e6232617-e61d-47af-a64b-041d3a45cb14 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:08:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e6232617-e61d-47af-a64b-041d3a45cb14 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e6232617-e61d-47af-a64b-041d3a45cb14 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e6232617-e61d-47af-a64b-041d3a45cb14', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443083', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113093', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12440766455422949341', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '60dbb47537920d5f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276225024', 'san:volume_id': '60dbb47537920d5f76922c8e245d19621087b34a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85663', 'name': 'v_e6232617-e61d-47af-a64b-041d3a45cb14', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e6232617-e61d-47af-a64b-041d3a45cb14 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] delete volume:v_e6232617-e61d-47af-a64b-041d3a45cb14 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:08:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e6232617-e61d-47af-a64b-041d3a45cb14 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e6232617-e61d-47af-a64b-041d3a45cb14 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e6232617-e61d-47af-a64b-041d3a45cb14 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] volume v_e6232617-e61d-47af-a64b-041d3a45cb14 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:08:17 user cinder-volume[73403]: DEBUG cinder.quota [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Created reservations ['6eb65456-1af7-4923-ab97-8f510919f529', 'bb102231-9fde-41f3-89f1-d7a57c42f850', '93c56f8b-8da0-4478-9f74-8fa26d79cf6b', 'ba791f63-2823-4096-b03a-e6c9f863baa2'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:08:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:08:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:08:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276319232', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:08:18 user cinder-volume[73403]: DEBUG cinder.manager [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:08:18 user cinder-volume[73403]: INFO cinder.volume.manager [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Deleted volume successfully. Apr 14 03:08:18 user cinder-volume[73403]: DEBUG cinder.coordination [None req-64963b1e-871e-4d46-9a65-2ba9e0e5028b tempest-VolumesListTestJSON-1278687108 None] Lock "cinder-e6232617-e61d-47af-a64b-041d3a45cb14-delete_volume" released by "delete_volume" :: held 3.569s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:08:21 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:08:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Flow 'volume_create_manager' (2df9182c-061b-4028-9da1-15ea8ec49a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:08:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d70aac7f-8f74-44c6-bddd-6ce08a19b641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:08:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d70aac7f-8f74-44c6-bddd-6ce08a19b641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2095910999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=eb69c0bd-af4f-438c-b96a-94c59261813a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4549f6080dcf4c739ac03ef643801fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:08:21Z,use_quota=True,user_id='0128a733bd6a4120addba5eda1cc05fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:08:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b01b5e3-9c28-44f7-9885-8d82974b5583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:08:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b01b5e3-9c28-44f7-9885-8d82974b5583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:08:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e30ecd-f541-4e61-b220-9ed6d3109783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:08:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e30ecd-f541-4e61-b220-9ed6d3109783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb69c0bd-af4f-438c-b96a-94c59261813a', 'volume_name': 'volume-eb69c0bd-af4f-438c-b96a-94c59261813a', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:08:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49cec2c9-64e5-4c28-87e8-3f4d8df3de4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:08:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49cec2c9-64e5-4c28-87e8-3f4d8df3de4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:08:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0abfba16-5314-402d-b5e0-bb3d2d946a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:08:21 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Volume eb69c0bd-af4f-438c-b96a-94c59261813a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb69c0bd-af4f-438c-b96a-94c59261813a', 'volume_size': 1} Apr 14 03:08:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] creating volume v_eb69c0bd-af4f-438c-b96a-94c59261813a. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:08:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] create volume {'name': 'v_eb69c0bd-af4f-438c-b96a-94c59261813a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:08:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_eb69c0bd-af4f-438c-b96a-94c59261813a', 'is_clone': False, 'name': 'v_eb69c0bd-af4f-438c-b96a-94c59261813a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0abfba16-5314-402d-b5e0-bb3d2d946a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb69c0bd-af4f-438c-b96a-94c59261813a', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:08:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8565ca1-b904-4f6d-99d8-46445c801483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:08:22 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Volume volume-eb69c0bd-af4f-438c-b96a-94c59261813a (eb69c0bd-af4f-438c-b96a-94c59261813a): created successfully Apr 14 03:08:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8565ca1-b904-4f6d-99d8-46445c801483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:08:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Flow 'volume_create_manager' (2df9182c-061b-4028-9da1-15ea8ec49a8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:08:22 user cinder-volume[73403]: INFO cinder.volume.manager [None req-3a1087f0-e076-4702-80a8-e1d40291ea75 tempest-VolumesSnapshotTestJSON-423841644 None] Created volume successfully. Apr 14 03:08:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] create export for volume: 05d362e8-1aaf-4bbb-8a9f-9f153920e00c. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:08:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] ensure volume 05d362e8-1aaf-4bbb-8a9f-9f153920e00c assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:08:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] check if targe iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:08:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] create target and attach volume 05d362e8-1aaf-4bbb-8a9f-9f153920e00c to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:08:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] create target iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:08:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Flow 'volume_create_manager' (6068ae49-1dba-4537-85e9-dd39e6773a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fecb373-ce2a-43ff-ad7c-938f757580a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fecb373-ce2a-43ff-ad7c-938f757580a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1131482370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a2998d0d-9ff4-4d46-a62f-30f7df32be1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4549f6080dcf4c739ac03ef643801fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:08:24Z,use_quota=True,user_id='0128a733bd6a4120addba5eda1cc05fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff7a433-dbd8-42dc-b64c-e71dad51f64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff7a433-dbd8-42dc-b64c-e71dad51f64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a145aae-c8fb-408b-9079-597ee4093170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a145aae-c8fb-408b-9079-597ee4093170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a2998d0d-9ff4-4d46-a62f-30f7df32be1f', 'volume_name': 'volume-a2998d0d-9ff4-4d46-a62f-30f7df32be1f', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f115cf-ab76-45ec-beac-e6b0e38dca77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f115cf-ab76-45ec-beac-e6b0e38dca77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f2576a-bb97-4abe-a739-f339769287a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:08:24 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Volume a2998d0d-9ff4-4d46-a62f-30f7df32be1f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a2998d0d-9ff4-4d46-a62f-30f7df32be1f', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Cloning a2998d0d-9ff4-4d46-a62f-30f7df32be1f from image 98e6a247-250b-4bb5-a947-e7f93598d16e at location (None, None). {{(pid=73403) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Acquiring lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" by "_prepare_image_cache_entry" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 3, 8, 24, 522310)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Found cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Attempting to retrieve cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=37,cinder:SELECT=57,cinder:INSERT=4,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 3, 8, 24, 538929)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Creating from source image-volume 482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] cloned volume 482f938f-083c-4221-99f8-3320a80b8725 to a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] cloning v_482f938f-083c-4221-99f8-3320a80b8725 to v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] create volume v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f from snapshot v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:08:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] atach volume v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c to target iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:08:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f', 'is_clone': True, 'full_name': 'Pool-0/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f', 'name': 'v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] get volume v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:08:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443114', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '113133', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15939533052635641257', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f72ca3523a4af516', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276212736', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86181', 'name': 'v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:26 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Marking volume a2998d0d-9ff4-4d46-a62f-30f7df32be1f as bootable. {{(pid=73403) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 03:08:26 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Copying metadata from image 98e6a247-250b-4bb5-a947-e7f93598d16e to a2998d0d-9ff4-4d46-a62f-30f7df32be1f. {{(pid=73403) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 03:08:26 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Creating volume glance metadata for volume a2998d0d-9ff4-4d46-a62f-30f7df32be1f backed by image 98e6a247-250b-4bb5-a947-e7f93598d16e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73403) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 03:08:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f2576a-bb97-4abe-a739-f339769287a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2998d0d-9ff4-4d46-a62f-30f7df32be1f', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:08:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055885b7-154c-4aac-92b8-3b400e0deefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:08:26 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Volume volume-a2998d0d-9ff4-4d46-a62f-30f7df32be1f (a2998d0d-9ff4-4d46-a62f-30f7df32be1f): created successfully Apr 14 03:08:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055885b7-154c-4aac-92b8-3b400e0deefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:08:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Flow 'volume_create_manager' (6068ae49-1dba-4537-85e9-dd39e6773a5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:08:26 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8c2640bd-0c49-4014-9a77-4c9435551afb tempest-VolumesSnapshotTestJSON-423841644 None] Created volume successfully. Apr 14 03:08:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6531336563613839', 'lun': 0, 'mode': 'wt', 'name': 'v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c', 'prod_id': 'Storage', 'scsi_id': 'e13eca89c9d649d0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] add credentails to target iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:08:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] Geting {'code': 201, 'error': None, 'data': {'name': 'KcHRlyjP'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] initialize_connection for 05d362e8-1aaf-4bbb-8a9f-9f153920e00c 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:08:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KcHRlyjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'f6acf2ef-4b28-4065-bb47-80775d83e693'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:08:27 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=64,cinder:UPDATE=23,cinder:INSERT=11,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:08:27 user cinder-volume[73403]: INFO cinder.volume.manager [req-86adadb3-34dd-4d9d-94ca-a6e0393f7464 req-8c7c953d-5eee-42f9-9757-2ace0fb842b5 tempest-ServerRescueNegativeTestJSON-773851452 None] attachment_update completed successfully. Apr 14 03:08:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-d607ddd1-9586-4316-b043-93302c915648 tempest-ServerActionsTestJSON-1848627478 None] terminate connection for 44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:08:41 user cinder-volume[73403]: INFO cinder.volume.manager [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-d607ddd1-9586-4316-b043-93302c915648 tempest-ServerActionsTestJSON-1848627478 None] Terminate volume connection completed successfully. Apr 14 03:08:41 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-d607ddd1-9586-4316-b043-93302c915648 tempest-ServerActionsTestJSON-1848627478 None] Deleting attachment 5118fd99-eb33-477a-930f-88dcb6f3179f. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:08:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-d607ddd1-9586-4316-b043-93302c915648 tempest-ServerActionsTestJSON-1848627478 None] remove_export for volume: 44f3cbc9-fd81-4185-aa74-0896739af983. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:08:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-d607ddd1-9586-4316-b043-93302c915648 tempest-ServerActionsTestJSON-1848627478 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:08:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-d607ddd1-9586-4316-b043-93302c915648 tempest-ServerActionsTestJSON-1848627478 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-368917324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=44f3cbc9-fd81-4185-aa74-0896739af983,launched_at=2023-04-14T03:06:39Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='4075885e26cb4adaad24d3ae6217fe35',provider_auth='CHAP rCsYcqle dmt65IHyECkAD0',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:06:38Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:07:06Z,use_quota=True,user_id='7dea23743ba945c4a9d539b8e277c653',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:08:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-d607ddd1-9586-4316-b043-93302c915648 tempest-ServerActionsTestJSON-1848627478 None] detach volume v_44f3cbc9-fd81-4185-aa74-0896739af983 from target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:08:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-d607ddd1-9586-4316-b043-93302c915648 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns/v_44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-d607ddd1-9586-4316-b043-93302c915648 tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns/v_44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-d607ddd1-9586-4316-b043-93302c915648 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns/v_44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-d607ddd1-9586-4316-b043-93302c915648 tempest-ServerActionsTestJSON-1848627478 None] delete target: iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:08:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-d607ddd1-9586-4316-b043-93302c915648 tempest-ServerActionsTestJSON-1848627478 None] delete target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:08:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-d607ddd1-9586-4316-b043-93302c915648 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-d607ddd1-9586-4316-b043-93302c915648 tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-d607ddd1-9586-4316-b043-93302c915648 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-d607ddd1-9586-4316-b043-93302c915648 tempest-ServerActionsTestJSON-1848627478 None] target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:08:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] create export for volume: 44f3cbc9-fd81-4185-aa74-0896739af983. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:08:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] ensure volume 44f3cbc9-fd81-4185-aa74-0896739af983 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:08:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] check if targe iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:08:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] create target and attach volume 44f3cbc9-fd81-4185-aa74-0896739af983 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:08:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] create target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:08:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] atach volume v_44f3cbc9-fd81-4185-aa74-0896739af983 to target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:08:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6562356334656261', 'lun': 0, 'mode': 'wt', 'name': 'v_44f3cbc9-fd81-4185-aa74-0896739af983', 'prod_id': 'Storage', 'scsi_id': 'eb5c4eba774e2823'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] add credentails to target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:08:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'name': 'rCsYcqle'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] initialize_connection for 44f3cbc9-fd81-4185-aa74-0896739af983 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:08:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rCsYcqle', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'dc1ebff7-3718-4344-8f48-15d70c443eac'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:08:49 user cinder-volume[73403]: INFO cinder.volume.manager [req-fd47067f-0779-4dc4-9147-3c95c7c98e59 req-c5a3a6c6-19ac-43d8-9399-7b0100c0f6e3 tempest-ServerActionsTestJSON-1848627478 None] attachment_update completed successfully. Apr 14 03:08:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d7233161-c817-44fc-9ade-798939881a93 req-68ee7250-0990-4f39-84bc-247c068142a0 tempest-TaggedBootDevicesTest_v242-641324897 None] terminate connection for d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:08:50 user cinder-volume[73403]: INFO cinder.volume.manager [req-d7233161-c817-44fc-9ade-798939881a93 req-68ee7250-0990-4f39-84bc-247c068142a0 tempest-TaggedBootDevicesTest_v242-641324897 None] Terminate volume connection completed successfully. Apr 14 03:08:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-d7233161-c817-44fc-9ade-798939881a93 req-68ee7250-0990-4f39-84bc-247c068142a0 tempest-TaggedBootDevicesTest_v242-641324897 None] Deleting attachment ea74a039-df1d-4c31-9fd6-1edcb23e777d. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:08:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d7233161-c817-44fc-9ade-798939881a93 req-68ee7250-0990-4f39-84bc-247c068142a0 tempest-TaggedBootDevicesTest_v242-641324897 None] remove_export for volume: d7ac81e3-c104-4bb3-ada5-ecd6969601f0. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:08:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d7233161-c817-44fc-9ade-798939881a93 req-68ee7250-0990-4f39-84bc-247c068142a0 tempest-TaggedBootDevicesTest_v242-641324897 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:08:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d7233161-c817-44fc-9ade-798939881a93 req-68ee7250-0990-4f39-84bc-247c068142a0 tempest-TaggedBootDevicesTest_v242-641324897 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1083887677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d7ac81e3-c104-4bb3-ada5-ecd6969601f0,launched_at=2023-04-14T03:06:34Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='f1d531e7f7004ebaa529cb60de3849e7',provider_auth='CHAP dqJMIbXg obeW1BulFNzwKh',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:06:31Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:06:56Z,use_quota=True,user_id='5a311491e2924c49b01fd42458ec2fc2',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:08:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d7233161-c817-44fc-9ade-798939881a93 req-68ee7250-0990-4f39-84bc-247c068142a0 tempest-TaggedBootDevicesTest_v242-641324897 None] detach volume v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 from target iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:08:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7233161-c817-44fc-9ade-798939881a93 req-68ee7250-0990-4f39-84bc-247c068142a0 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0/luns/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7233161-c817-44fc-9ade-798939881a93 req-68ee7250-0990-4f39-84bc-247c068142a0 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0/luns/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7233161-c817-44fc-9ade-798939881a93 req-68ee7250-0990-4f39-84bc-247c068142a0 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0/luns/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d7233161-c817-44fc-9ade-798939881a93 req-68ee7250-0990-4f39-84bc-247c068142a0 tempest-TaggedBootDevicesTest_v242-641324897 None] delete target: iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:08:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d7233161-c817-44fc-9ade-798939881a93 req-68ee7250-0990-4f39-84bc-247c068142a0 tempest-TaggedBootDevicesTest_v242-641324897 None] delete target iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:08:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7233161-c817-44fc-9ade-798939881a93 req-68ee7250-0990-4f39-84bc-247c068142a0 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7233161-c817-44fc-9ade-798939881a93 req-68ee7250-0990-4f39-84bc-247c068142a0 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7233161-c817-44fc-9ade-798939881a93 req-68ee7250-0990-4f39-84bc-247c068142a0 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d7233161-c817-44fc-9ade-798939881a93 req-68ee7250-0990-4f39-84bc-247c068142a0 tempest-TaggedBootDevicesTest_v242-641324897 None] target iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:08:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d7233161-c817-44fc-9ade-798939881a93 req-64dde7a5-e1ec-4945-8cf0-ad1e129e3973 tempest-TaggedBootDevicesTest_v242-641324897 None] terminate connection for e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:08:51 user cinder-volume[73403]: INFO cinder.volume.manager [req-d7233161-c817-44fc-9ade-798939881a93 req-64dde7a5-e1ec-4945-8cf0-ad1e129e3973 tempest-TaggedBootDevicesTest_v242-641324897 None] Terminate volume connection completed successfully. Apr 14 03:08:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-d7233161-c817-44fc-9ade-798939881a93 req-64dde7a5-e1ec-4945-8cf0-ad1e129e3973 tempest-TaggedBootDevicesTest_v242-641324897 None] Deleting attachment a8bb7005-4faf-4c15-926a-3d8c0ef7af87. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:08:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d7233161-c817-44fc-9ade-798939881a93 req-64dde7a5-e1ec-4945-8cf0-ad1e129e3973 tempest-TaggedBootDevicesTest_v242-641324897 None] remove_export for volume: e178f132-e302-4ee5-8ca6-45972e24754a. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:08:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d7233161-c817-44fc-9ade-798939881a93 req-64dde7a5-e1ec-4945-8cf0-ad1e129e3973 tempest-TaggedBootDevicesTest_v242-641324897 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:08:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d7233161-c817-44fc-9ade-798939881a93 req-64dde7a5-e1ec-4945-8cf0-ad1e129e3973 tempest-TaggedBootDevicesTest_v242-641324897 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1605752098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e178f132-e302-4ee5-8ca6-45972e24754a,launched_at=2023-04-14T03:06:39Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='f1d531e7f7004ebaa529cb60de3849e7',provider_auth='CHAP akyODBJC 7qo8Dj6csadfi2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:06:37Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:07:06Z,use_quota=True,user_id='5a311491e2924c49b01fd42458ec2fc2',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:08:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d7233161-c817-44fc-9ade-798939881a93 req-64dde7a5-e1ec-4945-8cf0-ad1e129e3973 tempest-TaggedBootDevicesTest_v242-641324897 None] detach volume v_e178f132-e302-4ee5-8ca6-45972e24754a from target iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:08:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7233161-c817-44fc-9ade-798939881a93 req-64dde7a5-e1ec-4945-8cf0-ad1e129e3973 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a/luns/v_e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7233161-c817-44fc-9ade-798939881a93 req-64dde7a5-e1ec-4945-8cf0-ad1e129e3973 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a/luns/v_e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7233161-c817-44fc-9ade-798939881a93 req-64dde7a5-e1ec-4945-8cf0-ad1e129e3973 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a/luns/v_e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d7233161-c817-44fc-9ade-798939881a93 req-64dde7a5-e1ec-4945-8cf0-ad1e129e3973 tempest-TaggedBootDevicesTest_v242-641324897 None] delete target: iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:08:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d7233161-c817-44fc-9ade-798939881a93 req-64dde7a5-e1ec-4945-8cf0-ad1e129e3973 tempest-TaggedBootDevicesTest_v242-641324897 None] delete target iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:08:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7233161-c817-44fc-9ade-798939881a93 req-64dde7a5-e1ec-4945-8cf0-ad1e129e3973 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7233161-c817-44fc-9ade-798939881a93 req-64dde7a5-e1ec-4945-8cf0-ad1e129e3973 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7233161-c817-44fc-9ade-798939881a93 req-64dde7a5-e1ec-4945-8cf0-ad1e129e3973 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d7233161-c817-44fc-9ade-798939881a93 req-64dde7a5-e1ec-4945-8cf0-ad1e129e3973 tempest-TaggedBootDevicesTest_v242-641324897 None] target iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:08:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d7233161-c817-44fc-9ade-798939881a93 req-988622c4-76a0-49a1-a2f0-8760fbca1cd0 tempest-TaggedBootDevicesTest_v242-641324897 None] terminate connection for f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:08:52 user cinder-volume[73403]: INFO cinder.volume.manager [req-d7233161-c817-44fc-9ade-798939881a93 req-988622c4-76a0-49a1-a2f0-8760fbca1cd0 tempest-TaggedBootDevicesTest_v242-641324897 None] Terminate volume connection completed successfully. Apr 14 03:08:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-d7233161-c817-44fc-9ade-798939881a93 req-988622c4-76a0-49a1-a2f0-8760fbca1cd0 tempest-TaggedBootDevicesTest_v242-641324897 None] Deleting attachment e108a1db-4cd6-4bc4-9856-cab7507514d9. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:08:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d7233161-c817-44fc-9ade-798939881a93 req-988622c4-76a0-49a1-a2f0-8760fbca1cd0 tempest-TaggedBootDevicesTest_v242-641324897 None] remove_export for volume: f9476602-ab81-47c8-aa31-ecc8e3c672ee. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:08:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d7233161-c817-44fc-9ade-798939881a93 req-988622c4-76a0-49a1-a2f0-8760fbca1cd0 tempest-TaggedBootDevicesTest_v242-641324897 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:08:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d7233161-c817-44fc-9ade-798939881a93 req-988622c4-76a0-49a1-a2f0-8760fbca1cd0 tempest-TaggedBootDevicesTest_v242-641324897 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1015327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f9476602-ab81-47c8-aa31-ecc8e3c672ee,launched_at=2023-04-14T03:06:37Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='f1d531e7f7004ebaa529cb60de3849e7',provider_auth='CHAP PhzIAFeq tYpAlHjImvcoJK',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:06:35Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:07:01Z,use_quota=True,user_id='5a311491e2924c49b01fd42458ec2fc2',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:08:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d7233161-c817-44fc-9ade-798939881a93 req-988622c4-76a0-49a1-a2f0-8760fbca1cd0 tempest-TaggedBootDevicesTest_v242-641324897 None] detach volume v_f9476602-ab81-47c8-aa31-ecc8e3c672ee from target iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:08:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7233161-c817-44fc-9ade-798939881a93 req-988622c4-76a0-49a1-a2f0-8760fbca1cd0 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee/luns/v_f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7233161-c817-44fc-9ade-798939881a93 req-988622c4-76a0-49a1-a2f0-8760fbca1cd0 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee/luns/v_f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7233161-c817-44fc-9ade-798939881a93 req-988622c4-76a0-49a1-a2f0-8760fbca1cd0 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee/luns/v_f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d7233161-c817-44fc-9ade-798939881a93 req-988622c4-76a0-49a1-a2f0-8760fbca1cd0 tempest-TaggedBootDevicesTest_v242-641324897 None] delete target: iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:08:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d7233161-c817-44fc-9ade-798939881a93 req-988622c4-76a0-49a1-a2f0-8760fbca1cd0 tempest-TaggedBootDevicesTest_v242-641324897 None] delete target iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:08:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7233161-c817-44fc-9ade-798939881a93 req-988622c4-76a0-49a1-a2f0-8760fbca1cd0 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:08:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7233161-c817-44fc-9ade-798939881a93 req-988622c4-76a0-49a1-a2f0-8760fbca1cd0 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:08:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d7233161-c817-44fc-9ade-798939881a93 req-988622c4-76a0-49a1-a2f0-8760fbca1cd0 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:08:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d7233161-c817-44fc-9ade-798939881a93 req-988622c4-76a0-49a1-a2f0-8760fbca1cd0 tempest-TaggedBootDevicesTest_v242-641324897 None] target iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:09:02 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=26,cinder:UPDATE=5 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:02 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=45,cinder:INSERT=5,cinder:UPDATE=6 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:09:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:09:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:09:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114266017792', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:09:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.coordination [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Acquiring lock "cinder-5106df68-dc27-4e16-9ea7-9c77a3d4ca23-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.coordination [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Lock "cinder-5106df68-dc27-4e16-9ea7-9c77a3d4ca23-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] remove_export for volume: 5106df68-dc27-4e16-9ea7-9c77a3d4ca23. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-57962786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5106df68-dc27-4e16-9ea7-9c77a3d4ca23,launched_at=2023-04-14T03:05:20Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a991a4fd13b4a819b24479a341ba08c',provider_auth='CHAP qSwoCLQN 0CZW2d5UzBX9AR',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:05:19Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:09:14Z,updated_at=2023-04-14T03:09:14Z,use_quota=True,user_id='17999fdd4eb449d49d74b4de20f6614a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] detach volume v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 from target iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23/luns/v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23/luns/v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23/luns/v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23/luns/v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] failed to remove resource iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 because of JDSS resource v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] delete target: iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] delete target iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] failed to remove resource iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 because of JDSS resource iqn.2010-10.org.openstack:5106df68-dc27-4e16-9ea7-9c77a3d4ca23 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] deleating volume v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] get snapshots for volume v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] get volume v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442928', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112969', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16346185064649735152', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd0cc241e76b2bd93', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114266017792', 'san:volume_id': 'd0cc241e76b2bd935511284e61a72c9989e6bb68', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85190', 'name': 'v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] delete volume:v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] volume v_5106df68-dc27-4e16-9ea7-9c77a3d4ca23 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:09:16 user cinder-volume[73403]: DEBUG cinder.quota [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Created reservations ['3c064525-8710-4b0d-bf7d-a5d9d20aa8a5', '41696052-2d27-402e-974a-1c7e53d64393', '16b4c4d7-91d0-43ea-bec4-1181b553a313', '687e6b81-a935-4769-bdb0-559c608c48e6'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:09:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:09:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:09:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Geting {'code': 200, 'error': None, 'data': {'available': '114266112000', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:09:17 user cinder-volume[73403]: DEBUG cinder.manager [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:09:17 user cinder-volume[73403]: INFO cinder.volume.manager [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Deleted volume successfully. Apr 14 03:09:17 user cinder-volume[73403]: DEBUG cinder.coordination [None req-0a2c8d29-d4a0-4a1e-b935-464e05fd6787 tempest-TaggedAttachmentsTest-1835109148 None] Lock "cinder-5106df68-dc27-4e16-9ea7-9c77a3d4ca23-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:09:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=16,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=19,cinder:UPDATE=8,cinder:INSERT=4 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:33 user cinder-volume[73403]: INFO cinder.volume.manager [None req-856e454c-0544-43b5-bb3b-ae0939355587 tempest-GroupsTest-1613227619 None] Group tempest-Group1-752056900: creating Apr 14 03:09:33 user cinder-volume[73403]: INFO cinder.volume.manager [None req-856e454c-0544-43b5-bb3b-ae0939355587 tempest-GroupsTest-1613227619 None] Group tempest-Group1-752056900: created successfully Apr 14 03:09:33 user cinder-volume[73403]: INFO cinder.volume.manager [None req-856e454c-0544-43b5-bb3b-ae0939355587 tempest-GroupsTest-1613227619 None] Create group completed successfully. Apr 14 03:09:35 user cinder-volume[73403]: INFO cinder.volume.manager [None req-b283528f-3fb7-48cf-8953-9d290f60abed tempest-GroupsTest-1613227619 None] Group tempest-Group2-1949279819: creating Apr 14 03:09:35 user cinder-volume[73403]: INFO cinder.volume.manager [None req-b283528f-3fb7-48cf-8953-9d290f60abed tempest-GroupsTest-1613227619 None] Group tempest-Group2-1949279819: created successfully Apr 14 03:09:35 user cinder-volume[73403]: INFO cinder.volume.manager [None req-b283528f-3fb7-48cf-8953-9d290f60abed tempest-GroupsTest-1613227619 None] Create group completed successfully. Apr 14 03:09:36 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:09:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Flow 'volume_create_manager' (b7809d46-285b-4f8f-a0a2-0fec64da2bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:09:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (449a53c7-1bab-46bb-ae39-253d2cca2a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:09:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (449a53c7-1bab-46bb-ae39-253d2cca2a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1120083999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c059ee1-8bd7-424a-8031-e9e40eae1923,host='user@joviandss-2#joviandss-2',id=ebae91b2-ac78-4a21-af0f-de794f8e7150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='630466963cd14afb9cd91bd7b5316b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:09:36Z,use_quota=True,user_id='d9f2fab0d0ba4448a79d6ab7499634ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37ea688c-e55e-4640-b821-4d693af6f555),volume_type_id=37ea688c-e55e-4640-b821-4d693af6f555)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:09:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04c51b6f-58e2-4421-9180-6b8b80c8b618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:09:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04c51b6f-58e2-4421-9180-6b8b80c8b618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:09:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4caf99-7654-4282-b449-1b7f830731c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:09:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4caf99-7654-4282-b449-1b7f830731c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebae91b2-ac78-4a21-af0f-de794f8e7150', 'volume_name': 'volume-ebae91b2-ac78-4a21-af0f-de794f8e7150', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:09:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07f6988-0b23-4861-95e0-53e6562a9c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:09:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07f6988-0b23-4861-95e0-53e6562a9c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:09:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080b213e-b6f3-4704-aebd-b378c9e75bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:09:36 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Volume ebae91b2-ac78-4a21-af0f-de794f8e7150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebae91b2-ac78-4a21-af0f-de794f8e7150', 'volume_size': 1} Apr 14 03:09:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] creating volume v_ebae91b2-ac78-4a21-af0f-de794f8e7150. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:09:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] create volume {'name': 'v_ebae91b2-ac78-4a21-af0f-de794f8e7150', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:09:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.coordination [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Acquiring lock "cinder-e178f132-e302-4ee5-8ca6-45972e24754a-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.coordination [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Lock "cinder-e178f132-e302-4ee5-8ca6-45972e24754a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] remove_export for volume: e178f132-e302-4ee5-8ca6-45972e24754a. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1605752098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e178f132-e302-4ee5-8ca6-45972e24754a,launched_at=2023-04-14T03:06:39Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d531e7f7004ebaa529cb60de3849e7',provider_auth='CHAP akyODBJC 7qo8Dj6csadfi2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:06:37Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:09:37Z,updated_at=2023-04-14T03:09:37Z,use_quota=True,user_id='5a311491e2924c49b01fd42458ec2fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] detach volume v_e178f132-e302-4ee5-8ca6-45972e24754a from target iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a/luns/v_e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a/luns/v_e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a/luns/v_e178f132-e302-4ee5-8ca6-45972e24754a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a/luns/v_e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] failed to remove resource iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a because of JDSS resource v_e178f132-e302-4ee5-8ca6-45972e24754a DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] delete target: iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] delete target iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] failed to remove resource iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a because of JDSS resource iqn.2010-10.org.openstack:e178f132-e302-4ee5-8ca6-45972e24754a DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] deleating volume v_e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] get snapshots for volume v_e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e178f132-e302-4ee5-8ca6-45972e24754a/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e178f132-e302-4ee5-8ca6-45972e24754a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_ebae91b2-ac78-4a21-af0f-de794f8e7150', 'is_clone': False, 'name': 'v_ebae91b2-ac78-4a21-af0f-de794f8e7150'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080b213e-b6f3-4704-aebd-b378c9e75bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebae91b2-ac78-4a21-af0f-de794f8e7150', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3590ab-880d-4a73-962d-41a344f60557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:09:37 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Volume volume-ebae91b2-ac78-4a21-af0f-de794f8e7150 (ebae91b2-ac78-4a21-af0f-de794f8e7150): created successfully Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3590ab-880d-4a73-962d-41a344f60557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Flow 'volume_create_manager' (b7809d46-285b-4f8f-a0a2-0fec64da2bbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:09:37 user cinder-volume[73403]: INFO cinder.volume.manager [None req-82c87b2b-6d66-4a91-a0f4-87360ec9a5a9 tempest-GroupsTest-1613227619 None] Created volume successfully. Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e178f132-e302-4ee5-8ca6-45972e24754a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] get volume v_e178f132-e302-4ee5-8ca6-45972e24754a info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e178f132-e302-4ee5-8ca6-45972e24754a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443007', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113018', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18147077184180819944', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e64c8405d15f46cb', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114266005504', 'san:volume_id': 'e64c8405d15f46cba12a674d5f0619ed86dc887e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86024', 'name': 'v_e178f132-e302-4ee5-8ca6-45972e24754a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] delete volume:v_e178f132-e302-4ee5-8ca6-45972e24754a recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] remove_export for volume: ebae91b2-ac78-4a21-af0f-de794f8e7150. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1120083999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c059ee1-8bd7-424a-8031-e9e40eae1923,host='user@joviandss-2#joviandss-2',id=ebae91b2-ac78-4a21-af0f-de794f8e7150,launched_at=2023-04-14T03:09:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='630466963cd14afb9cd91bd7b5316b20',provider_auth='CHAP NgCSlYpz fco9JRMrSiyzX6',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebae91b2-ac78-4a21-af0f-de794f8e7150 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:09:36Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T03:09:39Z,use_quota=True,user_id='d9f2fab0d0ba4448a79d6ab7499634ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37ea688c-e55e-4640-b821-4d693af6f555),volume_type_id=37ea688c-e55e-4640-b821-4d693af6f555) from target:iqn.2010-10.org.openstack:ebae91b2-ac78-4a21-af0f-de794f8e7150. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] detach volume v_ebae91b2-ac78-4a21-af0f-de794f8e7150 from target iqn.2010-10.org.openstack:ebae91b2-ac78-4a21-af0f-de794f8e7150 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ebae91b2-ac78-4a21-af0f-de794f8e7150/luns/v_ebae91b2-ac78-4a21-af0f-de794f8e7150 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ebae91b2-ac78-4a21-af0f-de794f8e7150/luns/v_ebae91b2-ac78-4a21-af0f-de794f8e7150 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ebae91b2-ac78-4a21-af0f-de794f8e7150 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ebae91b2-ac78-4a21-af0f-de794f8e7150/luns/v_ebae91b2-ac78-4a21-af0f-de794f8e7150'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ebae91b2-ac78-4a21-af0f-de794f8e7150/luns/v_ebae91b2-ac78-4a21-af0f-de794f8e7150 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] failed to remove resource iqn.2010-10.org.openstack:ebae91b2-ac78-4a21-af0f-de794f8e7150 because of JDSS resource v_ebae91b2-ac78-4a21-af0f-de794f8e7150 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] delete target: iqn.2010-10.org.openstack:ebae91b2-ac78-4a21-af0f-de794f8e7150 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] delete target iqn.2010-10.org.openstack:ebae91b2-ac78-4a21-af0f-de794f8e7150 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ebae91b2-ac78-4a21-af0f-de794f8e7150 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ebae91b2-ac78-4a21-af0f-de794f8e7150 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ebae91b2-ac78-4a21-af0f-de794f8e7150 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ebae91b2-ac78-4a21-af0f-de794f8e7150'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ebae91b2-ac78-4a21-af0f-de794f8e7150 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] failed to remove resource iqn.2010-10.org.openstack:ebae91b2-ac78-4a21-af0f-de794f8e7150 because of JDSS resource iqn.2010-10.org.openstack:ebae91b2-ac78-4a21-af0f-de794f8e7150 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] deleating volume v_ebae91b2-ac78-4a21-af0f-de794f8e7150 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] get snapshots for volume v_ebae91b2-ac78-4a21-af0f-de794f8e7150 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ebae91b2-ac78-4a21-af0f-de794f8e7150/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ebae91b2-ac78-4a21-af0f-de794f8e7150/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e178f132-e302-4ee5-8ca6-45972e24754a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] volume v_e178f132-e302-4ee5-8ca6-45972e24754a deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.quota [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Created reservations ['e5a31c0b-8ae3-4fa8-affa-913bf6ac1a5a', 'f7b1174d-de77-4ad0-a9ad-d45ec6923da9', 'c2b2beef-2962-4b17-8689-3a844b6fecfd', '7ecb20c3-18b9-4084-82ae-364040e1fd01'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ebae91b2-ac78-4a21-af0f-de794f8e7150/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] get volume v_ebae91b2-ac78-4a21-af0f-de794f8e7150 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ebae91b2-ac78-4a21-af0f-de794f8e7150 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ebae91b2-ac78-4a21-af0f-de794f8e7150 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ebae91b2-ac78-4a21-af0f-de794f8e7150', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443186', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113163', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5158681059422832798', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f19dcf969403b643', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114266112000', 'san:volume_id': 'f19dcf969403b6435fb387ecd52e5b60edf2bc69', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85927', 'name': 'v_ebae91b2-ac78-4a21-af0f-de794f8e7150', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ebae91b2-ac78-4a21-af0f-de794f8e7150 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] delete volume:v_ebae91b2-ac78-4a21-af0f-de794f8e7150 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ebae91b2-ac78-4a21-af0f-de794f8e7150 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ebae91b2-ac78-4a21-af0f-de794f8e7150 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 200, 'error': None, 'data': {'available': '114266112000', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.manager [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:09:40 user cinder-volume[73403]: INFO cinder.volume.manager [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Deleted volume successfully. Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.coordination [None req-0bb620cc-d032-4d6b-be03-aa9f2a06f8ea tempest-TaggedBootDevicesTest_v242-641324897 None] Lock "cinder-e178f132-e302-4ee5-8ca6-45972e24754a-delete_volume" released by "delete_volume" :: held 3.095s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.coordination [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Acquiring lock "cinder-f9476602-ab81-47c8-aa31-ecc8e3c672ee-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.coordination [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Lock "cinder-f9476602-ab81-47c8-aa31-ecc8e3c672ee-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] remove_export for volume: f9476602-ab81-47c8-aa31-ecc8e3c672ee. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1015327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f9476602-ab81-47c8-aa31-ecc8e3c672ee,launched_at=2023-04-14T03:06:37Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d531e7f7004ebaa529cb60de3849e7',provider_auth='CHAP PhzIAFeq tYpAlHjImvcoJK',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:06:35Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:09:41Z,updated_at=2023-04-14T03:09:41Z,use_quota=True,user_id='5a311491e2924c49b01fd42458ec2fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] detach volume v_f9476602-ab81-47c8-aa31-ecc8e3c672ee from target iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee/luns/v_f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee/luns/v_f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee/luns/v_f9476602-ab81-47c8-aa31-ecc8e3c672ee'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee/luns/v_f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] failed to remove resource iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee because of JDSS resource v_f9476602-ab81-47c8-aa31-ecc8e3c672ee DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] delete target: iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] delete target iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] failed to remove resource iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee because of JDSS resource iqn.2010-10.org.openstack:f9476602-ab81-47c8-aa31-ecc8e3c672ee DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] deleating volume v_f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] get snapshots for volume v_f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9476602-ab81-47c8-aa31-ecc8e3c672ee/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9476602-ab81-47c8-aa31-ecc8e3c672ee/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9476602-ab81-47c8-aa31-ecc8e3c672ee/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] get volume v_f9476602-ab81-47c8-aa31-ecc8e3c672ee info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:09:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f9476602-ab81-47c8-aa31-ecc8e3c672ee', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443004', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113014', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11363970559261782896', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '36228db5d3fc8e58', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114266206208', 'san:volume_id': '36228db5d3fc8e587afe7efdcaddc15b0cc4b90e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85115', 'name': 'v_f9476602-ab81-47c8-aa31-ecc8e3c672ee', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] delete volume:v_f9476602-ab81-47c8-aa31-ecc8e3c672ee recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:09:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ebae91b2-ac78-4a21-af0f-de794f8e7150 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] volume v_ebae91b2-ac78-4a21-af0f-de794f8e7150 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.quota [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Created reservations ['889c64c4-8482-4420-a541-b4c73d1b897e'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:09:42 user cinder-volume[73403]: WARNING cinder.quota [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-41343152 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-41343152, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:09:42 user cinder-volume[73403]: WARNING cinder.quota [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-41343152 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-41343152, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.quota [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Created reservations ['5e288d45-8560-4619-9a82-9225a1259941', 'e6c7d531-3be0-4d9d-b988-c54e8baaa55b', 'fc202a9c-e61e-499b-8412-28bae512b105', 'f99eae5a-9707-4916-b609-e2161ff3bc88'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.quota [None req-6d429f90-9b38-4050-a204-75b1f794814a tempest-GroupsTest-1613227619 None] Created reservations ['0277972e-933c-4fc5-bc77-27349134576b'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6d429f90-9b38-4050-a204-75b1f794814a tempest-GroupsTest-1613227619 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6d429f90-9b38-4050-a204-75b1f794814a tempest-GroupsTest-1613227619 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d429f90-9b38-4050-a204-75b1f794814a tempest-GroupsTest-1613227619 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d429f90-9b38-4050-a204-75b1f794814a tempest-GroupsTest-1613227619 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d429f90-9b38-4050-a204-75b1f794814a tempest-GroupsTest-1613227619 None] Geting {'code': 200, 'error': None, 'data': {'available': '114266112000', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6d429f90-9b38-4050-a204-75b1f794814a tempest-GroupsTest-1613227619 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.manager [None req-6d429f90-9b38-4050-a204-75b1f794814a tempest-GroupsTest-1613227619 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:09:42 user cinder-volume[73403]: INFO cinder.volume.manager [None req-6d429f90-9b38-4050-a204-75b1f794814a tempest-GroupsTest-1613227619 None] Delete group completed successfully. Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f9476602-ab81-47c8-aa31-ecc8e3c672ee {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] volume v_f9476602-ab81-47c8-aa31-ecc8e3c672ee deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.quota [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Created reservations ['c31ed25b-6ed6-4462-949c-e796e5abfd23', 'd2d9aa21-973d-4869-b48e-5f8e4eff247b', '40a1ab7a-a8e8-4cbb-8135-82b85b133b31', 'fa811de0-29a8-447f-af24-add591b7ff80'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=29,cinder:SELECT=65,cinder:INSERT=6 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=63,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=8 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 200, 'error': None, 'data': {'available': '114266112000', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:09:42 user cinder-volume[73403]: DEBUG cinder.manager [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Geting {'code': 200, 'error': None, 'data': {'available': '114266275840', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.manager [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:09:43 user cinder-volume[73403]: INFO cinder.volume.manager [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Deleted volume successfully. Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.coordination [None req-16ad48fc-5f96-498e-854c-401ccbf5beaf tempest-TaggedBootDevicesTest_v242-641324897 None] Lock "cinder-f9476602-ab81-47c8-aa31-ecc8e3c672ee-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:09:43 user cinder-volume[73403]: INFO cinder.volume.manager [None req-b21ed41f-6d71-4313-8f08-2baa63c3187d tempest-GroupsTest-1613227619 None] Delete group completed successfully. Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Acquiring lock "cinder-d7ac81e3-c104-4bb3-ada5-ecd6969601f0-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Lock "cinder-d7ac81e3-c104-4bb3-ada5-ecd6969601f0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] remove_export for volume: d7ac81e3-c104-4bb3-ada5-ecd6969601f0. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1083887677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d7ac81e3-c104-4bb3-ada5-ecd6969601f0,launched_at=2023-04-14T03:06:34Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d531e7f7004ebaa529cb60de3849e7',provider_auth='CHAP dqJMIbXg obeW1BulFNzwKh',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:06:31Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:09:44Z,updated_at=2023-04-14T03:09:44Z,use_quota=True,user_id='5a311491e2924c49b01fd42458ec2fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] detach volume v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 from target iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0/luns/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0/luns/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0/luns/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0/luns/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] failed to remove resource iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 because of JDSS resource v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] delete target: iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] delete target iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] failed to remove resource iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 because of JDSS resource iqn.2010-10.org.openstack:d7ac81e3-c104-4bb3-ada5-ecd6969601f0 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] deleating volume v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] get snapshots for volume v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:44 user cinder-volume[73403]: INFO cinder.volume.manager [None req-e891240a-4764-4742-ac5e-116d3faf562a tempest-GroupsTest-1613227619 None] Group tempest-GroupsTest-Group-561878043: creating Apr 14 03:09:44 user cinder-volume[73403]: INFO cinder.volume.manager [None req-e891240a-4764-4742-ac5e-116d3faf562a tempest-GroupsTest-1613227619 None] Group tempest-GroupsTest-Group-561878043: created successfully Apr 14 03:09:44 user cinder-volume[73403]: INFO cinder.volume.manager [None req-e891240a-4764-4742-ac5e-116d3faf562a tempest-GroupsTest-1613227619 None] Create group completed successfully. Apr 14 03:09:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] get volume v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:09:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443002', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26107904', 'sharesmb': None, 'createtxg': '113009', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10815094216602707398', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10129408', 'logicalused': '26030080', 'compressratio': '2.58', 'rootcontext': 'none', 'default_scsi_id': 'f5238eccdcb9cf96', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114266275840', 'san:volume_id': 'f5238eccdcb9cf96fe3c36901e4add2398c2bb8e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10129408', 'objsetid': '84476', 'name': 'v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10129408', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] delete snapshot v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 of volume v_482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:09:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Flow 'volume_create_manager' (833571ad-75ea-4f49-8ef5-c2ebbf65cef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6c130c-b064-459b-b88c-84c2c96a0c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6c130c-b064-459b-b88c-84c2c96a0c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1943026793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f8d1acf2-ea88-4e50-9b2c-49fe469dc102,host='user@joviandss-2#joviandss-2',id=568b85c8-eafd-4f8a-8fcc-15fb043f61ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='630466963cd14afb9cd91bd7b5316b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:09:46Z,use_quota=True,user_id='d9f2fab0d0ba4448a79d6ab7499634ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff580fc8-c9b3-4a5b-a713-2751dc3b0a58),volume_type_id=ff580fc8-c9b3-4a5b-a713-2751dc3b0a58)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e11d54-fd49-4123-b609-6f5fef956f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e11d54-fd49-4123-b609-6f5fef956f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d19a698-cf89-486a-a159-8f002741e703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d19a698-cf89-486a-a159-8f002741e703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '568b85c8-eafd-4f8a-8fcc-15fb043f61ed', 'volume_name': 'volume-568b85c8-eafd-4f8a-8fcc-15fb043f61ed', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954e0b4a-f9b1-42b6-b47e-627fc1daecb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954e0b4a-f9b1-42b6-b47e-627fc1daecb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea6e28b-4529-40d1-97cf-5e104d637869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:09:45 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Volume 568b85c8-eafd-4f8a-8fcc-15fb043f61ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-568b85c8-eafd-4f8a-8fcc-15fb043f61ed', 'volume_size': 1} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] creating volume v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] create volume {'name': 'v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] snapshot v_d7ac81e3-c104-4bb3-ada5-ecd6969601f0 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.quota [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Created reservations ['afc3d933-e34b-4070-81d3-ab0c180fa3f5', '7a82109c-b293-4c4b-85aa-65998ef3929c', '31abbc27-85c6-4763-826f-05225f9156c3', '914c9de3-285e-4089-b48f-499e3fb8abca'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed', 'is_clone': False, 'name': 'v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:46 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea6e28b-4529-40d1-97cf-5e104d637869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-568b85c8-eafd-4f8a-8fcc-15fb043f61ed', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:09:46 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82899085-9cb6-4a45-95bc-42d7a272d1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:09:46 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Volume volume-568b85c8-eafd-4f8a-8fcc-15fb043f61ed (568b85c8-eafd-4f8a-8fcc-15fb043f61ed): created successfully Apr 14 03:09:46 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82899085-9cb6-4a45-95bc-42d7a272d1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:09:46 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Flow 'volume_create_manager' (833571ad-75ea-4f49-8ef5-c2ebbf65cef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:09:46 user cinder-volume[73403]: INFO cinder.volume.manager [None req-fc81c22b-fdc3-44c0-917a-5dbd2b23e830 tempest-GroupsTest-1613227619 None] Created volume successfully. Apr 14 03:09:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276421632', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:09:46 user cinder-volume[73403]: DEBUG cinder.manager [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:09:46 user cinder-volume[73403]: INFO cinder.volume.manager [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Deleted volume successfully. Apr 14 03:09:46 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ff8cae22-d005-4d4b-b9fe-9556444c6d51 tempest-TaggedBootDevicesTest_v242-641324897 None] Lock "cinder-d7ac81e3-c104-4bb3-ada5-ecd6969601f0-delete_volume" released by "delete_volume" :: held 2.849s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:09:48 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:09:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Flow 'volume_create_manager' (522916b5-ac6f-405d-ab70-9090e05d5f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:09:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e43733-2dc7-455e-8e83-11f2ecbe9067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:09:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e43733-2dc7-455e-8e83-11f2ecbe9067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-439333241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f8d1acf2-ea88-4e50-9b2c-49fe469dc102,host='user@joviandss-2#joviandss-2',id=681af0e8-01a5-4675-af6e-986fafd89e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='630466963cd14afb9cd91bd7b5316b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:09:48Z,use_quota=True,user_id='d9f2fab0d0ba4448a79d6ab7499634ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff580fc8-c9b3-4a5b-a713-2751dc3b0a58),volume_type_id=ff580fc8-c9b3-4a5b-a713-2751dc3b0a58)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:09:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85737c3a-c220-495b-84f5-7af390a6059b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:09:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85737c3a-c220-495b-84f5-7af390a6059b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:09:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a26b3c7-31b7-4595-9329-7dff59a9ff40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:09:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a26b3c7-31b7-4595-9329-7dff59a9ff40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '681af0e8-01a5-4675-af6e-986fafd89e7f', 'volume_name': 'volume-681af0e8-01a5-4675-af6e-986fafd89e7f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:09:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98db417-86fb-4986-8b85-a771fc4ffab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:09:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98db417-86fb-4986-8b85-a771fc4ffab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:09:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4763278-16dc-4b7d-a2eb-43ddf70e2554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:09:48 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Volume 681af0e8-01a5-4675-af6e-986fafd89e7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-681af0e8-01a5-4675-af6e-986fafd89e7f', 'volume_size': 1} Apr 14 03:09:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] creating volume v_681af0e8-01a5-4675-af6e-986fafd89e7f. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:09:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] create volume {'name': 'v_681af0e8-01a5-4675-af6e-986fafd89e7f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:09:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_681af0e8-01a5-4675-af6e-986fafd89e7f', 'is_clone': False, 'name': 'v_681af0e8-01a5-4675-af6e-986fafd89e7f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4763278-16dc-4b7d-a2eb-43ddf70e2554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-681af0e8-01a5-4675-af6e-986fafd89e7f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:09:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1203ed85-07fe-4c38-bd67-7d98ce76573e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:09:49 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Volume volume-681af0e8-01a5-4675-af6e-986fafd89e7f (681af0e8-01a5-4675-af6e-986fafd89e7f): created successfully Apr 14 03:09:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1203ed85-07fe-4c38-bd67-7d98ce76573e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:09:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Flow 'volume_create_manager' (522916b5-ac6f-405d-ab70-9090e05d5f0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:09:49 user cinder-volume[73403]: INFO cinder.volume.manager [None req-826eca26-5bad-496e-991a-d0a7c4887bee tempest-GroupsTest-1613227619 None] Created volume successfully. Apr 14 03:09:49 user cinder-volume[73403]: INFO cinder.volume.manager [None req-bee47a23-0890-4bbb-ab8c-bbabf815d4ba tempest-GroupsTest-1613227619 None] Update group completed successfully. Apr 14 03:09:50 user cinder-volume[73403]: INFO cinder.volume.manager [None req-170b43d6-5fb9-400f-adaa-279e05abdc1e tempest-GroupsTest-1613227619 None] Update group completed successfully. Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] remove_export for volume: 568b85c8-eafd-4f8a-8fcc-15fb043f61ed. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1943026793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f8d1acf2-ea88-4e50-9b2c-49fe469dc102,host='user@joviandss-2#joviandss-2',id=568b85c8-eafd-4f8a-8fcc-15fb043f61ed,launched_at=2023-04-14T03:09:47Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='630466963cd14afb9cd91bd7b5316b20',provider_auth='CHAP NbeikjxU YAUcl8sfH0k5Dg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:568b85c8-eafd-4f8a-8fcc-15fb043f61ed 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:09:46Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T03:09:52Z,use_quota=True,user_id='d9f2fab0d0ba4448a79d6ab7499634ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff580fc8-c9b3-4a5b-a713-2751dc3b0a58),volume_type_id=ff580fc8-c9b3-4a5b-a713-2751dc3b0a58) from target:iqn.2010-10.org.openstack:568b85c8-eafd-4f8a-8fcc-15fb043f61ed. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] detach volume v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed from target iqn.2010-10.org.openstack:568b85c8-eafd-4f8a-8fcc-15fb043f61ed {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:568b85c8-eafd-4f8a-8fcc-15fb043f61ed/luns/v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:568b85c8-eafd-4f8a-8fcc-15fb043f61ed/luns/v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:568b85c8-eafd-4f8a-8fcc-15fb043f61ed not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:568b85c8-eafd-4f8a-8fcc-15fb043f61ed/luns/v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:568b85c8-eafd-4f8a-8fcc-15fb043f61ed/luns/v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] failed to remove resource iqn.2010-10.org.openstack:568b85c8-eafd-4f8a-8fcc-15fb043f61ed because of JDSS resource v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] delete target: iqn.2010-10.org.openstack:568b85c8-eafd-4f8a-8fcc-15fb043f61ed {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] delete target iqn.2010-10.org.openstack:568b85c8-eafd-4f8a-8fcc-15fb043f61ed {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:568b85c8-eafd-4f8a-8fcc-15fb043f61ed {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:568b85c8-eafd-4f8a-8fcc-15fb043f61ed {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:568b85c8-eafd-4f8a-8fcc-15fb043f61ed not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:568b85c8-eafd-4f8a-8fcc-15fb043f61ed'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:568b85c8-eafd-4f8a-8fcc-15fb043f61ed {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] failed to remove resource iqn.2010-10.org.openstack:568b85c8-eafd-4f8a-8fcc-15fb043f61ed because of JDSS resource iqn.2010-10.org.openstack:568b85c8-eafd-4f8a-8fcc-15fb043f61ed DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] deleating volume v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] get snapshots for volume v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] get volume v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443195', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113172', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13762936165632430543', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b5090b0685d0bb34', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276315136', 'san:volume_id': 'b5090b0685d0bb344edd1a55392b68050b528a5d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85408', 'name': 'v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] delete volume:v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] volume v_568b85c8-eafd-4f8a-8fcc-15fb043f61ed deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:09:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] remove_export for volume: 681af0e8-01a5-4675-af6e-986fafd89e7f. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:09:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:09:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-439333241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f8d1acf2-ea88-4e50-9b2c-49fe469dc102,host='user@joviandss-2#joviandss-2',id=681af0e8-01a5-4675-af6e-986fafd89e7f,launched_at=2023-04-14T03:09:49Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='630466963cd14afb9cd91bd7b5316b20',provider_auth='CHAP cXYDTeoi ODyYIw5edxMpzE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:681af0e8-01a5-4675-af6e-986fafd89e7f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:09:48Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T03:09:52Z,use_quota=True,user_id='d9f2fab0d0ba4448a79d6ab7499634ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff580fc8-c9b3-4a5b-a713-2751dc3b0a58),volume_type_id=ff580fc8-c9b3-4a5b-a713-2751dc3b0a58) from target:iqn.2010-10.org.openstack:681af0e8-01a5-4675-af6e-986fafd89e7f. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:09:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] detach volume v_681af0e8-01a5-4675-af6e-986fafd89e7f from target iqn.2010-10.org.openstack:681af0e8-01a5-4675-af6e-986fafd89e7f {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:09:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:681af0e8-01a5-4675-af6e-986fafd89e7f/luns/v_681af0e8-01a5-4675-af6e-986fafd89e7f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:681af0e8-01a5-4675-af6e-986fafd89e7f/luns/v_681af0e8-01a5-4675-af6e-986fafd89e7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:681af0e8-01a5-4675-af6e-986fafd89e7f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:681af0e8-01a5-4675-af6e-986fafd89e7f/luns/v_681af0e8-01a5-4675-af6e-986fafd89e7f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:681af0e8-01a5-4675-af6e-986fafd89e7f/luns/v_681af0e8-01a5-4675-af6e-986fafd89e7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] failed to remove resource iqn.2010-10.org.openstack:681af0e8-01a5-4675-af6e-986fafd89e7f because of JDSS resource v_681af0e8-01a5-4675-af6e-986fafd89e7f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:09:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] delete target: iqn.2010-10.org.openstack:681af0e8-01a5-4675-af6e-986fafd89e7f {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:09:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] delete target iqn.2010-10.org.openstack:681af0e8-01a5-4675-af6e-986fafd89e7f {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:09:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:681af0e8-01a5-4675-af6e-986fafd89e7f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:681af0e8-01a5-4675-af6e-986fafd89e7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:681af0e8-01a5-4675-af6e-986fafd89e7f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:681af0e8-01a5-4675-af6e-986fafd89e7f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:681af0e8-01a5-4675-af6e-986fafd89e7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] failed to remove resource iqn.2010-10.org.openstack:681af0e8-01a5-4675-af6e-986fafd89e7f because of JDSS resource iqn.2010-10.org.openstack:681af0e8-01a5-4675-af6e-986fafd89e7f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:09:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] deleating volume v_681af0e8-01a5-4675-af6e-986fafd89e7f {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:09:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] get snapshots for volume v_681af0e8-01a5-4675-af6e-986fafd89e7f {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:09:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_681af0e8-01a5-4675-af6e-986fafd89e7f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_681af0e8-01a5-4675-af6e-986fafd89e7f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_681af0e8-01a5-4675-af6e-986fafd89e7f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] get volume v_681af0e8-01a5-4675-af6e-986fafd89e7f info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:09:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_681af0e8-01a5-4675-af6e-986fafd89e7f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_681af0e8-01a5-4675-af6e-986fafd89e7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_681af0e8-01a5-4675-af6e-986fafd89e7f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443197', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113176', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9994424457796044111', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '91a4e0bc684e4232', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276409344', 'san:volume_id': '91a4e0bc684e423260501fe377417048724d0186', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85708', 'name': 'v_681af0e8-01a5-4675-af6e-986fafd89e7f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_681af0e8-01a5-4675-af6e-986fafd89e7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] delete volume:v_681af0e8-01a5-4675-af6e-986fafd89e7f recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:09:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_681af0e8-01a5-4675-af6e-986fafd89e7f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_681af0e8-01a5-4675-af6e-986fafd89e7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_681af0e8-01a5-4675-af6e-986fafd89e7f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] volume v_681af0e8-01a5-4675-af6e-986fafd89e7f deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:09:57 user cinder-volume[73403]: DEBUG cinder.quota [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Created reservations ['3dc6025a-3948-4241-8785-62994037bc7b'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:09:57 user cinder-volume[73403]: WARNING cinder.quota [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1970654987 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1970654987, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:09:57 user cinder-volume[73403]: WARNING cinder.quota [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1970654987 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1970654987, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:09:57 user cinder-volume[73403]: DEBUG cinder.quota [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Created reservations ['4c1928d5-9100-4f42-9747-151dad54f838', '50ed2afe-ea3b-4c0a-b7a5-a5ed5844c9ce', '110656fb-31b4-4908-89fd-8fe6d65c0991', 'c09ed89a-8c6b-44d2-aa48-053afdaf4f82'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:09:57 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=29,cinder:SELECT=65,cinder:DELETE=3,cinder:INSERT=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:57 user cinder-volume[73403]: DEBUG cinder.quota [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Created reservations ['f0595277-3d22-462f-97ca-1447f00f05fa', 'f064caa0-cf3c-443b-90ba-aa7917163ac8', '3b13ff6b-6109-4b4f-9ce6-8dedfcc5dcd1', '97829c0c-c78f-4f5e-ae15-8ee7deeceb6e'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:09:57 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=34,cinder:SELECT=55,cinder:INSERT=10,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:09:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:09:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:09:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:09:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:09:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276491264', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:09:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:09:58 user cinder-volume[73403]: DEBUG cinder.manager [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:09:58 user cinder-volume[73403]: INFO cinder.volume.manager [None req-f25a36c5-f706-4893-bd99-f0a66999c2e1 tempest-GroupsTest-1613227619 None] Delete group completed successfully. Apr 14 03:10:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-94888dc0-d782-440c-9087-d21054e29ac5 req-e35a3a02-4cc2-496b-ac96-6b39a34a3746 tempest-TestVolumeBootPattern-910285030 None] terminate connection for c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:10:01 user cinder-volume[73403]: INFO cinder.volume.manager [req-94888dc0-d782-440c-9087-d21054e29ac5 req-e35a3a02-4cc2-496b-ac96-6b39a34a3746 tempest-TestVolumeBootPattern-910285030 None] Terminate volume connection completed successfully. Apr 14 03:10:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-94888dc0-d782-440c-9087-d21054e29ac5 req-e35a3a02-4cc2-496b-ac96-6b39a34a3746 tempest-TestVolumeBootPattern-910285030 None] Deleting attachment d90b3770-b8d3-4a03-8ecd-9841fb06a5f8. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:10:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-94888dc0-d782-440c-9087-d21054e29ac5 req-e35a3a02-4cc2-496b-ac96-6b39a34a3746 tempest-TestVolumeBootPattern-910285030 None] remove_export for volume: c6fbfee2-70fa-477a-a761-8d092061e691. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:10:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-94888dc0-d782-440c-9087-d21054e29ac5 req-e35a3a02-4cc2-496b-ac96-6b39a34a3746 tempest-TestVolumeBootPattern-910285030 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:10:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-94888dc0-d782-440c-9087-d21054e29ac5 req-e35a3a02-4cc2-496b-ac96-6b39a34a3746 tempest-TestVolumeBootPattern-910285030 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1818179131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c6fbfee2-70fa-477a-a761-8d092061e691,launched_at=2023-04-14T03:08:04Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='2d2e49e8e92e416faebf55e3d4e0e087',provider_auth='CHAP tekamKoO sDhWrA2PuO1ceX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:08:01Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:08:11Z,use_quota=True,user_id='60e11b7ab2914209b23bf7a53791da64',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:10:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-94888dc0-d782-440c-9087-d21054e29ac5 req-e35a3a02-4cc2-496b-ac96-6b39a34a3746 tempest-TestVolumeBootPattern-910285030 None] detach volume v_c6fbfee2-70fa-477a-a761-8d092061e691 from target iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:10:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-94888dc0-d782-440c-9087-d21054e29ac5 req-e35a3a02-4cc2-496b-ac96-6b39a34a3746 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/luns/v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-94888dc0-d782-440c-9087-d21054e29ac5 req-e35a3a02-4cc2-496b-ac96-6b39a34a3746 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/luns/v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-94888dc0-d782-440c-9087-d21054e29ac5 req-e35a3a02-4cc2-496b-ac96-6b39a34a3746 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/luns/v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-94888dc0-d782-440c-9087-d21054e29ac5 req-e35a3a02-4cc2-496b-ac96-6b39a34a3746 tempest-TestVolumeBootPattern-910285030 None] delete target: iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:10:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-94888dc0-d782-440c-9087-d21054e29ac5 req-e35a3a02-4cc2-496b-ac96-6b39a34a3746 tempest-TestVolumeBootPattern-910285030 None] delete target iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:10:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-94888dc0-d782-440c-9087-d21054e29ac5 req-e35a3a02-4cc2-496b-ac96-6b39a34a3746 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-94888dc0-d782-440c-9087-d21054e29ac5 req-e35a3a02-4cc2-496b-ac96-6b39a34a3746 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:02 user cinder-volume[73403]: INFO cinder.volume.manager [None req-1b5d2b92-6241-451f-8bdb-2e67e0b2cba6 tempest-GroupsV314Test-558807599 None] Group tempest-GroupsV314Test-Group-936543695: creating Apr 14 03:10:02 user cinder-volume[73403]: INFO cinder.volume.manager [None req-1b5d2b92-6241-451f-8bdb-2e67e0b2cba6 tempest-GroupsV314Test-558807599 None] Group tempest-GroupsV314Test-Group-936543695: created successfully Apr 14 03:10:02 user cinder-volume[73403]: INFO cinder.volume.manager [None req-1b5d2b92-6241-451f-8bdb-2e67e0b2cba6 tempest-GroupsV314Test-558807599 None] Create group completed successfully. Apr 14 03:10:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-94888dc0-d782-440c-9087-d21054e29ac5 req-e35a3a02-4cc2-496b-ac96-6b39a34a3746 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-94888dc0-d782-440c-9087-d21054e29ac5 req-e35a3a02-4cc2-496b-ac96-6b39a34a3746 tempest-TestVolumeBootPattern-910285030 None] target iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:10:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:10:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:10:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:10:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:03 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:10:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Flow 'volume_create_manager' (9965c2bf-a38c-4a9b-b1a3-e9bfcb0c4355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:10:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9e67f8-3f4d-4319-bb3c-459e08d67000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276483072', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:10:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:10:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9e67f8-3f4d-4319-bb3c-459e08d67000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-620073109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e05b13aa-94ab-4bd8-9152-edc86975ce3e,host='user@joviandss-2#joviandss-2',id=16cec020-59e1-4f7f-bcf7-cdc66eef1a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eda3ffb3a044959a076ec8f61dab011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:10:04Z,use_quota=True,user_id='6cdff933b99e4e389fddd98174a66bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aea28e5f-b4d4-4936-9338-3e08dbdfc6ca),volume_type_id=aea28e5f-b4d4-4936-9338-3e08dbdfc6ca)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3db374-c143-47bf-9847-e8f5eed23235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3db374-c143-47bf-9847-e8f5eed23235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f48fd5e0-a67c-48c9-88aa-32e3a9a6262a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f48fd5e0-a67c-48c9-88aa-32e3a9a6262a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16cec020-59e1-4f7f-bcf7-cdc66eef1a6a', 'volume_name': 'volume-16cec020-59e1-4f7f-bcf7-cdc66eef1a6a', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56472d92-64bc-4d3b-83ab-d81814c4855b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56472d92-64bc-4d3b-83ab-d81814c4855b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555673ee-5c04-4add-8a08-8e647c1ab6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:04 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Volume 16cec020-59e1-4f7f-bcf7-cdc66eef1a6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16cec020-59e1-4f7f-bcf7-cdc66eef1a6a', 'volume_size': 1} Apr 14 03:10:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] creating volume v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:10:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] create volume {'name': 'v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:10:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a', 'is_clone': False, 'name': 'v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:05 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555673ee-5c04-4add-8a08-8e647c1ab6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16cec020-59e1-4f7f-bcf7-cdc66eef1a6a', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:05 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (281c0cb7-2a6c-4b56-85ed-6cd7d31a800c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:05 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Volume volume-16cec020-59e1-4f7f-bcf7-cdc66eef1a6a (16cec020-59e1-4f7f-bcf7-cdc66eef1a6a): created successfully Apr 14 03:10:05 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (281c0cb7-2a6c-4b56-85ed-6cd7d31a800c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:05 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Flow 'volume_create_manager' (9965c2bf-a38c-4a9b-b1a3-e9bfcb0c4355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:10:05 user cinder-volume[73403]: INFO cinder.volume.manager [None req-4a0e1781-1109-4e48-9224-43fb01884ae2 tempest-GroupsV314Test-558807599 None] Created volume successfully. Apr 14 03:10:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d758b0f1-6957-4343-9f3a-de1525b17d83 tempest-GroupsV314Test-558807599 None] cloned volume 16cec020-59e1-4f7f-bcf7-cdc66eef1a6a to a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 03:10:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d758b0f1-6957-4343-9f3a-de1525b17d83 tempest-GroupsV314Test-558807599 None] cloning v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a to v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:10:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d758b0f1-6957-4343-9f3a-de1525b17d83 tempest-GroupsV314Test-558807599 None] create snapshot v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:10:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d758b0f1-6957-4343-9f3a-de1525b17d83 tempest-GroupsV314Test-558807599 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d758b0f1-6957-4343-9f3a-de1525b17d83 tempest-GroupsV314Test-558807599 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d758b0f1-6957-4343-9f3a-de1525b17d83 tempest-GroupsV314Test-558807599 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d758b0f1-6957-4343-9f3a-de1525b17d83 tempest-GroupsV314Test-558807599 None] create volume v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 from snapshot v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:10:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d758b0f1-6957-4343-9f3a-de1525b17d83 tempest-GroupsV314Test-558807599 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d758b0f1-6957-4343-9f3a-de1525b17d83 tempest-GroupsV314Test-558807599 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d758b0f1-6957-4343-9f3a-de1525b17d83 tempest-GroupsV314Test-558807599 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a@v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12', 'is_clone': True, 'full_name': 'Pool-0/v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12', 'name': 'v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d758b0f1-6957-4343-9f3a-de1525b17d83 tempest-GroupsV314Test-558807599 None] get volume v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:10:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d758b0f1-6957-4343-9f3a-de1525b17d83 tempest-GroupsV314Test-558807599 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d758b0f1-6957-4343-9f3a-de1525b17d83 tempest-GroupsV314Test-558807599 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d758b0f1-6957-4343-9f3a-de1525b17d83 tempest-GroupsV314Test-558807599 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a@v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443217', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113192', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5022189546062701833', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1c557f85a2103f6a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276376576', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85735', 'name': 'v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:08 user cinder-volume[73403]: INFO cinder.volume.manager [None req-d758b0f1-6957-4343-9f3a-de1525b17d83 tempest-GroupsV314Test-558807599 None] Create group from source-group-e05b13aa-94ab-4bd8-9152-edc86975ce3e completed successfully. Apr 14 03:10:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] remove_export for volume: a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:10:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:10:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=427205db-9a1c-4bc2-b850-5d43fe8bbbbe,host='user@joviandss-2#joviandss-2',id=a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eda3ffb3a044959a076ec8f61dab011',provider_auth='CHAP NhZDjRHK oH3kqgw9QRSPAB',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=None,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=16cec020-59e1-4f7f-bcf7-cdc66eef1a6a,status='deleting',terminated_at=None,updated_at=2023-04-14T03:10:10Z,use_quota=True,user_id='6cdff933b99e4e389fddd98174a66bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aea28e5f-b4d4-4936-9338-3e08dbdfc6ca),volume_type_id=aea28e5f-b4d4-4936-9338-3e08dbdfc6ca) from target:iqn.2010-10.org.openstack:a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:10:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] detach volume v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 from target iqn.2010-10.org.openstack:a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:10:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12/luns/v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12/luns/v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12/luns/v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12/luns/v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] failed to remove resource iqn.2010-10.org.openstack:a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 because of JDSS resource v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:10:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] delete target: iqn.2010-10.org.openstack:a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:10:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] delete target iqn.2010-10.org.openstack:a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:10:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] failed to remove resource iqn.2010-10.org.openstack:a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 because of JDSS resource iqn.2010-10.org.openstack:a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:10:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] deleating volume v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:10:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] get snapshots for volume v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:10:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] get volume v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a@v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443217', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113192', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5022189546062701833', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1c557f85a2103f6a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276352000', 'san:volume_id': '1c557f85a2103f6aeb6958c4c9c48ee0fe7c2276', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85735', 'name': 'v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] delete snapshot v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 of volume v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a/snapshots/v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a/snapshots/v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Flow 'volume_create_manager' (a266821f-a695-44b5-95b0-9329ea63bf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e829301-d608-4efb-a4be-39d022fd7d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e829301-d608-4efb-a4be-39d022fd7d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1739499124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d036730b-83f8-4181-bc64-2c80ee0e312f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130665008cf648cf87467ae2777a9170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:10:10Z,use_quota=True,user_id='d6d78d4991b5493e8893034e91ed407b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2dee91a-de8e-4400-8f58-bbf2fd0f0574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2dee91a-de8e-4400-8f58-bbf2fd0f0574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1e3d10-6ebe-46e3-ae9a-febcf0e3557d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1e3d10-6ebe-46e3-ae9a-febcf0e3557d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd036730b-83f8-4181-bc64-2c80ee0e312f', 'volume_name': 'volume-d036730b-83f8-4181-bc64-2c80ee0e312f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a425d035-6972-4b09-bce1-49a4ea931187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a425d035-6972-4b09-bce1-49a4ea931187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (791b31fb-d496-4bfa-b881-05ffd25f79ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:10 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Volume d036730b-83f8-4181-bc64-2c80ee0e312f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d036730b-83f8-4181-bc64-2c80ee0e312f', 'volume_size': 1} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] creating volume v_d036730b-83f8-4181-bc64-2c80ee0e312f. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] create volume {'name': 'v_d036730b-83f8-4181-bc64-2c80ee0e312f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d036730b-83f8-4181-bc64-2c80ee0e312f', 'is_clone': False, 'name': 'v_d036730b-83f8-4181-bc64-2c80ee0e312f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (791b31fb-d496-4bfa-b881-05ffd25f79ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d036730b-83f8-4181-bc64-2c80ee0e312f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b579ee94-e680-44d8-9c80-68ba7f5314f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:11 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Volume volume-d036730b-83f8-4181-bc64-2c80ee0e312f (d036730b-83f8-4181-bc64-2c80ee0e312f): created successfully Apr 14 03:10:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b579ee94-e680-44d8-9c80-68ba7f5314f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Flow 'volume_create_manager' (a266821f-a695-44b5-95b0-9329ea63bf81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:10:11 user cinder-volume[73403]: INFO cinder.volume.manager [None req-d92faf62-7725-462d-aa01-1124e91cf597 tempest-AttachVolumeTestJSON-975876676 None] Created volume successfully. Apr 14 03:10:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a/snapshots/v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] snapshot v_a0fbe602-f5ac-4b67-8e5e-31cd1fdfcb12 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:10:12 user cinder-volume[73403]: DEBUG cinder.quota [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Created reservations ['14bcab63-8e30-4d65-b48b-f2233b9c429b'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:10:12 user cinder-volume[73403]: WARNING cinder.quota [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-411923200 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-411923200, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:10:12 user cinder-volume[73403]: WARNING cinder.quota [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-411923200 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-411923200, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:10:12 user cinder-volume[73403]: DEBUG cinder.quota [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Created reservations ['fe35f6b2-cc5a-4ddd-a466-ac566b4e1557', 'cbb70e75-be0a-4623-a63d-ceb71539dee5', 'b3bd8cb2-698c-4609-b5eb-b0a4da353cfa', '7a759f84-f764-4024-af50-a28195ddd154'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:10:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:10:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:10:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276257792', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:10:12 user cinder-volume[73403]: DEBUG cinder.manager [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:10:12 user cinder-volume[73403]: INFO cinder.volume.manager [None req-e60ce89e-739b-4966-8087-e9211bcfd61b tempest-GroupsV314Test-558807599 None] Delete group completed successfully. Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] create export for volume: d036730b-83f8-4181-bc64-2c80ee0e312f. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] ensure volume d036730b-83f8-4181-bc64-2c80ee0e312f assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] check if targe iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] create target and attach volume d036730b-83f8-4181-bc64-2c80ee0e312f to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] create target iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] remove_export for volume: 16cec020-59e1-4f7f-bcf7-cdc66eef1a6a. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-620073109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e05b13aa-94ab-4bd8-9152-edc86975ce3e,host='user@joviandss-2#joviandss-2',id=16cec020-59e1-4f7f-bcf7-cdc66eef1a6a,launched_at=2023-04-14T03:10:05Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eda3ffb3a044959a076ec8f61dab011',provider_auth='CHAP lauCnBUY nxXZSPcNjUudpw',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:16cec020-59e1-4f7f-bcf7-cdc66eef1a6a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:10:04Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T03:10:13Z,use_quota=True,user_id='6cdff933b99e4e389fddd98174a66bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aea28e5f-b4d4-4936-9338-3e08dbdfc6ca),volume_type_id=aea28e5f-b4d4-4936-9338-3e08dbdfc6ca) from target:iqn.2010-10.org.openstack:16cec020-59e1-4f7f-bcf7-cdc66eef1a6a. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] detach volume v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a from target iqn.2010-10.org.openstack:16cec020-59e1-4f7f-bcf7-cdc66eef1a6a {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16cec020-59e1-4f7f-bcf7-cdc66eef1a6a/luns/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16cec020-59e1-4f7f-bcf7-cdc66eef1a6a/luns/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:16cec020-59e1-4f7f-bcf7-cdc66eef1a6a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16cec020-59e1-4f7f-bcf7-cdc66eef1a6a/luns/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16cec020-59e1-4f7f-bcf7-cdc66eef1a6a/luns/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] failed to remove resource iqn.2010-10.org.openstack:16cec020-59e1-4f7f-bcf7-cdc66eef1a6a because of JDSS resource v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] delete target: iqn.2010-10.org.openstack:16cec020-59e1-4f7f-bcf7-cdc66eef1a6a {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] delete target iqn.2010-10.org.openstack:16cec020-59e1-4f7f-bcf7-cdc66eef1a6a {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16cec020-59e1-4f7f-bcf7-cdc66eef1a6a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16cec020-59e1-4f7f-bcf7-cdc66eef1a6a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:16cec020-59e1-4f7f-bcf7-cdc66eef1a6a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16cec020-59e1-4f7f-bcf7-cdc66eef1a6a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:16cec020-59e1-4f7f-bcf7-cdc66eef1a6a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] failed to remove resource iqn.2010-10.org.openstack:16cec020-59e1-4f7f-bcf7-cdc66eef1a6a because of JDSS resource iqn.2010-10.org.openstack:16cec020-59e1-4f7f-bcf7-cdc66eef1a6a DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] deleating volume v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] get snapshots for volume v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] get volume v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443213', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113186', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15329997134910814182', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f28237acd19c7132', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276257792', 'san:volume_id': 'f28237acd19c71321704ff2086a214827562f9c4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85722', 'name': 'v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] delete volume:v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] volume v_16cec020-59e1-4f7f-bcf7-cdc66eef1a6a deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:10:15 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=31,cinder:SELECT=67,cinder:INSERT=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:15 user cinder-volume[73403]: DEBUG cinder.quota [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Created reservations ['f7a7525b-d0ac-4e9e-a821-4e75e67c67b3'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:10:15 user cinder-volume[73403]: DEBUG cinder.quota [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Created reservations ['625c9cd9-623c-42ae-958e-7aabe9d4be34', '27e912b8-f746-4164-842a-de643e14c2af', '1cffbc84-4199-4598-88a8-17abe589fce1', '06e4f9ab-8ff3-45eb-91f8-10f42c7c82ee'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:10:15 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=62,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=8 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:10:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:10:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] atach volume v_d036730b-83f8-4181-bc64-2c80ee0e312f to target iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:10:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276339712', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:10:16 user cinder-volume[73403]: DEBUG cinder.manager [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:10:16 user cinder-volume[73403]: INFO cinder.volume.manager [None req-d3175392-a906-4b45-b634-f7851980faeb tempest-GroupsV314Test-558807599 None] Delete group completed successfully. Apr 14 03:10:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6131663861383139', 'lun': 0, 'mode': 'wt', 'name': 'v_d036730b-83f8-4181-bc64-2c80ee0e312f', 'prod_id': 'Storage', 'scsi_id': 'a1f8a819f367f44f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] add credentails to target iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:10:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 201, 'error': None, 'data': {'name': 'TEzqAxBi'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] initialize_connection for d036730b-83f8-4181-bc64-2c80ee0e312f 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:10:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEzqAxBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '35c493ab-857a-4662-8b80-53150558a58b'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:10:17 user cinder-volume[73403]: INFO cinder.volume.manager [req-b7c0da23-79d5-45f0-9878-273d642d3aac req-8c054903-18fb-49c7-a65b-fc2845abeff8 tempest-AttachVolumeTestJSON-975876676 None] attachment_update completed successfully. Apr 14 03:10:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] create export for volume: a2998d0d-9ff4-4d46-a62f-30f7df32be1f. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:10:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] ensure volume a2998d0d-9ff4-4d46-a62f-30f7df32be1f assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:10:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] check if targe iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:10:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] create target and attach volume a2998d0d-9ff4-4d46-a62f-30f7df32be1f to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:10:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] create target iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:10:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:20 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:10:20 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Flow 'volume_create_manager' (f89fb02f-2f87-4d2b-98bd-124b86be95e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:10:20 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15e07b7b-c951-4c7e-a973-120cdcd5e266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:20 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15e07b7b-c951-4c7e-a973-120cdcd5e266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1962594783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4ab737c6-db1d-4122-beea-9f6938803b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130665008cf648cf87467ae2777a9170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:10:21Z,use_quota=True,user_id='d6d78d4991b5493e8893034e91ed407b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:20 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5621c5-9441-49fe-9df7-1c0d25e9a05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:20 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5621c5-9441-49fe-9df7-1c0d25e9a05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:20 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde58326-b551-4338-af4e-ab73e4545ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:20 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde58326-b551-4338-af4e-ab73e4545ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab737c6-db1d-4122-beea-9f6938803b8a', 'volume_name': 'volume-4ab737c6-db1d-4122-beea-9f6938803b8a', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:20 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50e87c5-6f97-4bba-95db-508e25e0ba21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:20 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50e87c5-6f97-4bba-95db-508e25e0ba21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:20 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b31be8e-fac7-41f2-a78d-0899f4c37363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:20 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Volume 4ab737c6-db1d-4122-beea-9f6938803b8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab737c6-db1d-4122-beea-9f6938803b8a', 'volume_size': 1} Apr 14 03:10:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] creating volume v_4ab737c6-db1d-4122-beea-9f6938803b8a. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:10:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] create volume {'name': 'v_4ab737c6-db1d-4122-beea-9f6938803b8a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:10:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] atach volume v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f to target iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:10:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_4ab737c6-db1d-4122-beea-9f6938803b8a', 'is_clone': False, 'name': 'v_4ab737c6-db1d-4122-beea-9f6938803b8a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b31be8e-fac7-41f2-a78d-0899f4c37363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab737c6-db1d-4122-beea-9f6938803b8a', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b87a658-51fc-41d3-8466-a430c2359962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:22 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Volume volume-4ab737c6-db1d-4122-beea-9f6938803b8a (4ab737c6-db1d-4122-beea-9f6938803b8a): created successfully Apr 14 03:10:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b87a658-51fc-41d3-8466-a430c2359962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Flow 'volume_create_manager' (f89fb02f-2f87-4d2b-98bd-124b86be95e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:10:22 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8c549342-acdc-4798-a538-e0dc0616b8ed tempest-AttachVolumeTestJSON-975876676 None] Created volume successfully. Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Flow 'volume_create_manager' (8fab9863-24c8-47df-93f0-2551158a6b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b352d8-055c-40dc-a417-938c47814541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b352d8-055c-40dc-a417-938c47814541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-569973521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=117adce3-717a-4664-8cfa-be7d1f5d0169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1318728a20064d49b9c1b2f89175a364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:10:23Z,use_quota=True,user_id='b2facbf385e8402c86706cc28d4707af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a63eff-2a5f-4a65-b847-233766ca339c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a63eff-2a5f-4a65-b847-233766ca339c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e616854d-e882-43d4-b363-7d4f9b863229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e616854d-e882-43d4-b363-7d4f9b863229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117adce3-717a-4664-8cfa-be7d1f5d0169', 'volume_name': 'volume-117adce3-717a-4664-8cfa-be7d1f5d0169', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c550932-dc8d-42f2-ad16-23e4d42f3586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c550932-dc8d-42f2-ad16-23e4d42f3586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7894c5b8-cc74-4968-8a36-1c893102aa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:23 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Volume 117adce3-717a-4664-8cfa-be7d1f5d0169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117adce3-717a-4664-8cfa-be7d1f5d0169', 'volume_size': 1} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] creating volume v_117adce3-717a-4664-8cfa-be7d1f5d0169. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] create volume {'name': 'v_117adce3-717a-4664-8cfa-be7d1f5d0169', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6637326361333532', 'lun': 0, 'mode': 'wt', 'name': 'v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f', 'prod_id': 'Storage', 'scsi_id': 'f72ca3523a4af516'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] add credentails to target iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] create export for volume: 4ab737c6-db1d-4122-beea-9f6938803b8a. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] ensure volume 4ab737c6-db1d-4122-beea-9f6938803b8a assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] check if targe iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] create target and attach volume 4ab737c6-db1d-4122-beea-9f6938803b8a to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] create target iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 201, 'error': None, 'data': {'name': 'ZzhfkMEd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] initialize_connection for a2998d0d-9ff4-4d46-a62f-30f7df32be1f 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:10:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzhfkMEd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '57342732-1f05-437e-8055-2bd938640127'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:10:23 user cinder-volume[73403]: INFO cinder.volume.manager [req-9dd36333-ea8d-4201-9359-feeada9c4a70 req-cae8717f-b2c8-4d31-a928-ea8a1c026c07 tempest-VolumesSnapshotTestJSON-423841644 None] attachment_update completed successfully. Apr 14 03:10:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_117adce3-717a-4664-8cfa-be7d1f5d0169', 'is_clone': False, 'name': 'v_117adce3-717a-4664-8cfa-be7d1f5d0169'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7894c5b8-cc74-4968-8a36-1c893102aa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117adce3-717a-4664-8cfa-be7d1f5d0169', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684ebaa9-6302-42d7-adfe-a169ecf35fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:10:24 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Volume volume-117adce3-717a-4664-8cfa-be7d1f5d0169 (117adce3-717a-4664-8cfa-be7d1f5d0169): created successfully Apr 14 03:10:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684ebaa9-6302-42d7-adfe-a169ecf35fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:10:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Flow 'volume_create_manager' (8fab9863-24c8-47df-93f0-2551158a6b0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:10:24 user cinder-volume[73403]: INFO cinder.volume.manager [None req-86084bac-7844-4d95-9efc-018d679ef10e tempest-VolumesActionsTest-121883605 None] Created volume successfully. Apr 14 03:10:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] atach volume v_4ab737c6-db1d-4122-beea-9f6938803b8a to target iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:10:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a64abf4-f7b9-4f90-adb2-543d86ed1da2 tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot a94a88ba-ff28-462a-aa8c-801c30a49dc2 for volume a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:10:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a64abf4-f7b9-4f90-adb2-543d86ed1da2 tempest-VolumesSnapshotTestJSON-423841644 None] cloning v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f to s_a94a88ba-ff28-462a-aa8c-801c30a49dc2 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:10:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a64abf4-f7b9-4f90-adb2-543d86ed1da2 tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot s_a94a88ba-ff28-462a-aa8c-801c30a49dc2 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:10:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a64abf4-f7b9-4f90-adb2-543d86ed1da2 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a64abf4-f7b9-4f90-adb2-543d86ed1da2 tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a64abf4-f7b9-4f90-adb2-543d86ed1da2 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_a94a88ba-ff28-462a-aa8c-801c30a49dc2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a64abf4-f7b9-4f90-adb2-543d86ed1da2 tempest-VolumesSnapshotTestJSON-423841644 None] create volume s_a94a88ba-ff28-462a-aa8c-801c30a49dc2 from snapshot s_a94a88ba-ff28-462a-aa8c-801c30a49dc2 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:10:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a64abf4-f7b9-4f90-adb2-543d86ed1da2 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a64abf4-f7b9-4f90-adb2-543d86ed1da2 tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3464393730363966', 'lun': 0, 'mode': 'wt', 'name': 'v_4ab737c6-db1d-4122-beea-9f6938803b8a', 'prod_id': 'Storage', 'scsi_id': '4d97069fa92643af'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] add credentails to target iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:10:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 201, 'error': None, 'data': {'name': 'DMJkXsZY'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] initialize_connection for 4ab737c6-db1d-4122-beea-9f6938803b8a 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:10:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMJkXsZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '8f2f9ba1-eeec-4e0d-9cfc-fbf0e2df3ee7'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:10:28 user cinder-volume[73403]: INFO cinder.volume.manager [req-c688884e-23bd-4dde-8a6a-3aae4f38d758 req-0becc59a-20df-4492-94ae-4b7c18259fe9 tempest-AttachVolumeTestJSON-975876676 None] attachment_update completed successfully. Apr 14 03:10:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a64abf4-f7b9-4f90-adb2-543d86ed1da2 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f@s_a94a88ba-ff28-462a-aa8c-801c30a49dc2', 'is_clone': True, 'full_name': 'Pool-0/s_a94a88ba-ff28-462a-aa8c-801c30a49dc2', 'name': 's_a94a88ba-ff28-462a-aa8c-801c30a49dc2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a64abf4-f7b9-4f90-adb2-543d86ed1da2 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a94a88ba-ff28-462a-aa8c-801c30a49dc2/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a64abf4-f7b9-4f90-adb2-543d86ed1da2 tempest-VolumesSnapshotTestJSON-423841644 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a94a88ba-ff28-462a-aa8c-801c30a49dc2/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a64abf4-f7b9-4f90-adb2-543d86ed1da2 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a94a88ba-ff28-462a-aa8c-801c30a49dc2/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a64abf4-f7b9-4f90-adb2-543d86ed1da2 tempest-VolumesSnapshotTestJSON-423841644 None] volume s_a94a88ba-ff28-462a-aa8c-801c30a49dc2 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:10:29 user cinder-volume[73403]: INFO cinder.volume.manager [None req-5a64abf4-f7b9-4f90-adb2-543d86ed1da2 tempest-VolumesSnapshotTestJSON-423841644 None] Create snapshot completed successfully Apr 14 03:10:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b428f0b-1262-4756-a193-f0b262d7b957 tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot b60b4c66-697e-4911-ba4a-68cf47ccaa1b for volume a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:10:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b428f0b-1262-4756-a193-f0b262d7b957 tempest-VolumesSnapshotTestJSON-423841644 None] cloning v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f to s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:10:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b428f0b-1262-4756-a193-f0b262d7b957 tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:10:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b428f0b-1262-4756-a193-f0b262d7b957 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b428f0b-1262-4756-a193-f0b262d7b957 tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b428f0b-1262-4756-a193-f0b262d7b957 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_b60b4c66-697e-4911-ba4a-68cf47ccaa1b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b428f0b-1262-4756-a193-f0b262d7b957 tempest-VolumesSnapshotTestJSON-423841644 None] create volume s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b from snapshot s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:10:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b428f0b-1262-4756-a193-f0b262d7b957 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b428f0b-1262-4756-a193-f0b262d7b957 tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b428f0b-1262-4756-a193-f0b262d7b957 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f@s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b', 'is_clone': True, 'full_name': 'Pool-0/s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b', 'name': 's_b60b4c66-697e-4911-ba4a-68cf47ccaa1b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b428f0b-1262-4756-a193-f0b262d7b957 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b428f0b-1262-4756-a193-f0b262d7b957 tempest-VolumesSnapshotTestJSON-423841644 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b428f0b-1262-4756-a193-f0b262d7b957 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b428f0b-1262-4756-a193-f0b262d7b957 tempest-VolumesSnapshotTestJSON-423841644 None] volume s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:10:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=71,cinder:UPDATE=26,cinder:INSERT=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:32 user cinder-volume[73403]: INFO cinder.volume.manager [None req-6b428f0b-1262-4756-a193-f0b262d7b957 tempest-VolumesSnapshotTestJSON-423841644 None] Create snapshot completed successfully Apr 14 03:10:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c1397fc-2926-4a7a-a43c-c72ef7f6fccb tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot adc7ede1-9c99-45bb-a117-6023c2cd37ee for volume a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:10:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c1397fc-2926-4a7a-a43c-c72ef7f6fccb tempest-VolumesSnapshotTestJSON-423841644 None] cloning v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f to s_adc7ede1-9c99-45bb-a117-6023c2cd37ee {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:10:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c1397fc-2926-4a7a-a43c-c72ef7f6fccb tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot s_adc7ede1-9c99-45bb-a117-6023c2cd37ee {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:10:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1397fc-2926-4a7a-a43c-c72ef7f6fccb tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1397fc-2926-4a7a-a43c-c72ef7f6fccb tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 req-d8de7ab0-a52d-4777-a29a-e2b63c3e0a2a tempest-AttachVolumeTestJSON-975876676 None] terminate connection for d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:10:34 user cinder-volume[73403]: INFO cinder.volume.manager [req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 req-d8de7ab0-a52d-4777-a29a-e2b63c3e0a2a tempest-AttachVolumeTestJSON-975876676 None] Terminate volume connection completed successfully. Apr 14 03:10:34 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 req-d8de7ab0-a52d-4777-a29a-e2b63c3e0a2a tempest-AttachVolumeTestJSON-975876676 None] Deleting attachment 35c493ab-857a-4662-8b80-53150558a58b. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:10:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 req-d8de7ab0-a52d-4777-a29a-e2b63c3e0a2a tempest-AttachVolumeTestJSON-975876676 None] remove_export for volume: d036730b-83f8-4181-bc64-2c80ee0e312f. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:10:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 req-d8de7ab0-a52d-4777-a29a-e2b63c3e0a2a tempest-AttachVolumeTestJSON-975876676 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:10:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 req-d8de7ab0-a52d-4777-a29a-e2b63c3e0a2a tempest-AttachVolumeTestJSON-975876676 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1739499124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d036730b-83f8-4181-bc64-2c80ee0e312f,launched_at=2023-04-14T03:10:11Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='130665008cf648cf87467ae2777a9170',provider_auth='CHAP TEzqAxBi xUGyEhOmXPBbia',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:10:10Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:10:33Z,use_quota=True,user_id='d6d78d4991b5493e8893034e91ed407b',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:10:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 req-d8de7ab0-a52d-4777-a29a-e2b63c3e0a2a tempest-AttachVolumeTestJSON-975876676 None] detach volume v_d036730b-83f8-4181-bc64-2c80ee0e312f from target iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:10:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 req-d8de7ab0-a52d-4777-a29a-e2b63c3e0a2a tempest-AttachVolumeTestJSON-975876676 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f/luns/v_d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 req-d8de7ab0-a52d-4777-a29a-e2b63c3e0a2a tempest-AttachVolumeTestJSON-975876676 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f/luns/v_d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 req-d8de7ab0-a52d-4777-a29a-e2b63c3e0a2a tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f/luns/v_d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 req-d8de7ab0-a52d-4777-a29a-e2b63c3e0a2a tempest-AttachVolumeTestJSON-975876676 None] delete target: iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:10:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 req-d8de7ab0-a52d-4777-a29a-e2b63c3e0a2a tempest-AttachVolumeTestJSON-975876676 None] delete target iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:10:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 req-d8de7ab0-a52d-4777-a29a-e2b63c3e0a2a tempest-AttachVolumeTestJSON-975876676 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 req-d8de7ab0-a52d-4777-a29a-e2b63c3e0a2a tempest-AttachVolumeTestJSON-975876676 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1397fc-2926-4a7a-a43c-c72ef7f6fccb tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_adc7ede1-9c99-45bb-a117-6023c2cd37ee'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c1397fc-2926-4a7a-a43c-c72ef7f6fccb tempest-VolumesSnapshotTestJSON-423841644 None] create volume s_adc7ede1-9c99-45bb-a117-6023c2cd37ee from snapshot s_adc7ede1-9c99-45bb-a117-6023c2cd37ee {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:10:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1397fc-2926-4a7a-a43c-c72ef7f6fccb tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1397fc-2926-4a7a-a43c-c72ef7f6fccb tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 req-d8de7ab0-a52d-4777-a29a-e2b63c3e0a2a tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5a5c32c2-c42b-4282-b664-6c1ff43a4803 req-d8de7ab0-a52d-4777-a29a-e2b63c3e0a2a tempest-AttachVolumeTestJSON-975876676 None] target iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:10:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1397fc-2926-4a7a-a43c-c72ef7f6fccb tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f@s_adc7ede1-9c99-45bb-a117-6023c2cd37ee', 'is_clone': True, 'full_name': 'Pool-0/s_adc7ede1-9c99-45bb-a117-6023c2cd37ee', 'name': 's_adc7ede1-9c99-45bb-a117-6023c2cd37ee'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1397fc-2926-4a7a-a43c-c72ef7f6fccb tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_adc7ede1-9c99-45bb-a117-6023c2cd37ee/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1397fc-2926-4a7a-a43c-c72ef7f6fccb tempest-VolumesSnapshotTestJSON-423841644 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_adc7ede1-9c99-45bb-a117-6023c2cd37ee/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c1397fc-2926-4a7a-a43c-c72ef7f6fccb tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_adc7ede1-9c99-45bb-a117-6023c2cd37ee/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c1397fc-2926-4a7a-a43c-c72ef7f6fccb tempest-VolumesSnapshotTestJSON-423841644 None] volume s_adc7ede1-9c99-45bb-a117-6023c2cd37ee properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:10:35 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=16,cinder:SELECT=56,cinder:DELETE=4,cinder:INSERT=24 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:10:35 user cinder-volume[73403]: INFO cinder.volume.manager [None req-5c1397fc-2926-4a7a-a43c-c72ef7f6fccb tempest-VolumesSnapshotTestJSON-423841644 None] Create snapshot completed successfully Apr 14 03:10:36 user cinder-volume[73403]: DEBUG cinder.coordination [None req-35c281e6-a1de-4822-ac7e-4716cccff427 tempest-VolumesSnapshotTestJSON-423841644 None] Acquiring lock "cinder-a94a88ba-ff28-462a-aa8c-801c30a49dc2-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:10:36 user cinder-volume[73403]: DEBUG cinder.coordination [None req-35c281e6-a1de-4822-ac7e-4716cccff427 tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-a94a88ba-ff28-462a-aa8c-801c30a49dc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:10:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35c281e6-a1de-4822-ac7e-4716cccff427 tempest-VolumesSnapshotTestJSON-423841644 None] deleating snapshot s_a94a88ba-ff28-462a-aa8c-801c30a49dc2. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:10:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35c281e6-a1de-4822-ac7e-4716cccff427 tempest-VolumesSnapshotTestJSON-423841644 None] get snapshots for volume s_a94a88ba-ff28-462a-aa8c-801c30a49dc2 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:10:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35c281e6-a1de-4822-ac7e-4716cccff427 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a94a88ba-ff28-462a-aa8c-801c30a49dc2/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35c281e6-a1de-4822-ac7e-4716cccff427 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a94a88ba-ff28-462a-aa8c-801c30a49dc2/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b45712cc-23c9-45f0-85d7-122bede1cee3 req-7f946470-b167-4afa-b228-1c3ddafa8cff tempest-AttachVolumeTestJSON-975876676 None] terminate connection for 4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:10:37 user cinder-volume[73403]: INFO cinder.volume.manager [req-b45712cc-23c9-45f0-85d7-122bede1cee3 req-7f946470-b167-4afa-b228-1c3ddafa8cff tempest-AttachVolumeTestJSON-975876676 None] Terminate volume connection completed successfully. Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-b45712cc-23c9-45f0-85d7-122bede1cee3 req-7f946470-b167-4afa-b228-1c3ddafa8cff tempest-AttachVolumeTestJSON-975876676 None] Deleting attachment 8f2f9ba1-eeec-4e0d-9cfc-fbf0e2df3ee7. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b45712cc-23c9-45f0-85d7-122bede1cee3 req-7f946470-b167-4afa-b228-1c3ddafa8cff tempest-AttachVolumeTestJSON-975876676 None] remove_export for volume: 4ab737c6-db1d-4122-beea-9f6938803b8a. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b45712cc-23c9-45f0-85d7-122bede1cee3 req-7f946470-b167-4afa-b228-1c3ddafa8cff tempest-AttachVolumeTestJSON-975876676 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b45712cc-23c9-45f0-85d7-122bede1cee3 req-7f946470-b167-4afa-b228-1c3ddafa8cff tempest-AttachVolumeTestJSON-975876676 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1962594783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4ab737c6-db1d-4122-beea-9f6938803b8a,launched_at=2023-04-14T03:10:22Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='130665008cf648cf87467ae2777a9170',provider_auth='CHAP DMJkXsZY Yo9PJHyeAOTqLi',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:10:21Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:10:36Z,use_quota=True,user_id='d6d78d4991b5493e8893034e91ed407b',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b45712cc-23c9-45f0-85d7-122bede1cee3 req-7f946470-b167-4afa-b228-1c3ddafa8cff tempest-AttachVolumeTestJSON-975876676 None] detach volume v_4ab737c6-db1d-4122-beea-9f6938803b8a from target iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b45712cc-23c9-45f0-85d7-122bede1cee3 req-7f946470-b167-4afa-b228-1c3ddafa8cff tempest-AttachVolumeTestJSON-975876676 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a/luns/v_4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b45712cc-23c9-45f0-85d7-122bede1cee3 req-7f946470-b167-4afa-b228-1c3ddafa8cff tempest-AttachVolumeTestJSON-975876676 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a/luns/v_4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35c281e6-a1de-4822-ac7e-4716cccff427 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a94a88ba-ff28-462a-aa8c-801c30a49dc2/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35c281e6-a1de-4822-ac7e-4716cccff427 tempest-VolumesSnapshotTestJSON-423841644 None] get volume s_a94a88ba-ff28-462a-aa8c-801c30a49dc2 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35c281e6-a1de-4822-ac7e-4716cccff427 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a94a88ba-ff28-462a-aa8c-801c30a49dc2 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35c281e6-a1de-4822-ac7e-4716cccff427 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a94a88ba-ff28-462a-aa8c-801c30a49dc2 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35c281e6-a1de-4822-ac7e-4716cccff427 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f@s_a94a88ba-ff28-462a-aa8c-801c30a49dc2', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_a94a88ba-ff28-462a-aa8c-801c30a49dc2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443237', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '113226', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8141133233423995301', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd87e41e1c95ef318', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276065280', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84670', 'name': 's_a94a88ba-ff28-462a-aa8c-801c30a49dc2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a94a88ba-ff28-462a-aa8c-801c30a49dc2 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35c281e6-a1de-4822-ac7e-4716cccff427 tempest-VolumesSnapshotTestJSON-423841644 None] delete snapshot s_a94a88ba-ff28-462a-aa8c-801c30a49dc2 of volume v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35c281e6-a1de-4822-ac7e-4716cccff427 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots/s_a94a88ba-ff28-462a-aa8c-801c30a49dc2 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35c281e6-a1de-4822-ac7e-4716cccff427 tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots/s_a94a88ba-ff28-462a-aa8c-801c30a49dc2 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b45712cc-23c9-45f0-85d7-122bede1cee3 req-7f946470-b167-4afa-b228-1c3ddafa8cff tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a/luns/v_4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b45712cc-23c9-45f0-85d7-122bede1cee3 req-7f946470-b167-4afa-b228-1c3ddafa8cff tempest-AttachVolumeTestJSON-975876676 None] delete target: iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b45712cc-23c9-45f0-85d7-122bede1cee3 req-7f946470-b167-4afa-b228-1c3ddafa8cff tempest-AttachVolumeTestJSON-975876676 None] delete target iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b45712cc-23c9-45f0-85d7-122bede1cee3 req-7f946470-b167-4afa-b228-1c3ddafa8cff tempest-AttachVolumeTestJSON-975876676 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b45712cc-23c9-45f0-85d7-122bede1cee3 req-7f946470-b167-4afa-b228-1c3ddafa8cff tempest-AttachVolumeTestJSON-975876676 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b45712cc-23c9-45f0-85d7-122bede1cee3 req-7f946470-b167-4afa-b228-1c3ddafa8cff tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b45712cc-23c9-45f0-85d7-122bede1cee3 req-7f946470-b167-4afa-b228-1c3ddafa8cff tempest-AttachVolumeTestJSON-975876676 None] target iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:10:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35c281e6-a1de-4822-ac7e-4716cccff427 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots/s_a94a88ba-ff28-462a-aa8c-801c30a49dc2 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35c281e6-a1de-4822-ac7e-4716cccff427 tempest-VolumesSnapshotTestJSON-423841644 None] snapshot s_a94a88ba-ff28-462a-aa8c-801c30a49dc2 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:10:39 user cinder-volume[73403]: DEBUG cinder.quota [None req-35c281e6-a1de-4822-ac7e-4716cccff427 tempest-VolumesSnapshotTestJSON-423841644 None] Created reservations ['40d3e2b2-28ad-455c-85df-72392654b675', '6871cc61-43d3-40af-93e2-99735601381f', '0d319812-456d-4ec5-b8b1-ac4e8efe7489', 'f6bd58a3-27f6-4c5e-890f-2c7b262428e1'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:10:39 user cinder-volume[73403]: INFO cinder.volume.manager [None req-35c281e6-a1de-4822-ac7e-4716cccff427 tempest-VolumesSnapshotTestJSON-423841644 None] Delete snapshot completed successfully. Apr 14 03:10:39 user cinder-volume[73403]: DEBUG cinder.coordination [None req-35c281e6-a1de-4822-ac7e-4716cccff427 tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-a94a88ba-ff28-462a-aa8c-801c30a49dc2-delete_snapshot" released by "delete_snapshot" :: held 2.658s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:10:40 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5c431288-cdfe-46f5-831a-00d66142f479 tempest-VolumesSnapshotTestJSON-423841644 None] Acquiring lock "cinder-adc7ede1-9c99-45bb-a117-6023c2cd37ee-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:10:40 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5c431288-cdfe-46f5-831a-00d66142f479 tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-adc7ede1-9c99-45bb-a117-6023c2cd37ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:10:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c431288-cdfe-46f5-831a-00d66142f479 tempest-VolumesSnapshotTestJSON-423841644 None] deleating snapshot s_adc7ede1-9c99-45bb-a117-6023c2cd37ee. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:10:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c431288-cdfe-46f5-831a-00d66142f479 tempest-VolumesSnapshotTestJSON-423841644 None] get snapshots for volume s_adc7ede1-9c99-45bb-a117-6023c2cd37ee {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:10:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c431288-cdfe-46f5-831a-00d66142f479 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_adc7ede1-9c99-45bb-a117-6023c2cd37ee/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c431288-cdfe-46f5-831a-00d66142f479 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_adc7ede1-9c99-45bb-a117-6023c2cd37ee/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c431288-cdfe-46f5-831a-00d66142f479 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_adc7ede1-9c99-45bb-a117-6023c2cd37ee/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c431288-cdfe-46f5-831a-00d66142f479 tempest-VolumesSnapshotTestJSON-423841644 None] get volume s_adc7ede1-9c99-45bb-a117-6023c2cd37ee info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:10:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c431288-cdfe-46f5-831a-00d66142f479 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_adc7ede1-9c99-45bb-a117-6023c2cd37ee {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c431288-cdfe-46f5-831a-00d66142f479 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_adc7ede1-9c99-45bb-a117-6023c2cd37ee {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c431288-cdfe-46f5-831a-00d66142f479 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f@s_adc7ede1-9c99-45bb-a117-6023c2cd37ee', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_adc7ede1-9c99-45bb-a117-6023c2cd37ee', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443244', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '113238', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18176024142930648997', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8a8d1116ef86a355', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276089856', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85842', 'name': 's_adc7ede1-9c99-45bb-a117-6023c2cd37ee', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_adc7ede1-9c99-45bb-a117-6023c2cd37ee {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c431288-cdfe-46f5-831a-00d66142f479 tempest-VolumesSnapshotTestJSON-423841644 None] delete snapshot s_adc7ede1-9c99-45bb-a117-6023c2cd37ee of volume v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:10:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c431288-cdfe-46f5-831a-00d66142f479 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots/s_adc7ede1-9c99-45bb-a117-6023c2cd37ee {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c431288-cdfe-46f5-831a-00d66142f479 tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots/s_adc7ede1-9c99-45bb-a117-6023c2cd37ee {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c431288-cdfe-46f5-831a-00d66142f479 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots/s_adc7ede1-9c99-45bb-a117-6023c2cd37ee {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c431288-cdfe-46f5-831a-00d66142f479 tempest-VolumesSnapshotTestJSON-423841644 None] snapshot s_adc7ede1-9c99-45bb-a117-6023c2cd37ee deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:10:42 user cinder-volume[73403]: DEBUG cinder.quota [None req-5c431288-cdfe-46f5-831a-00d66142f479 tempest-VolumesSnapshotTestJSON-423841644 None] Created reservations ['c43df567-bcde-4b7a-b500-581df0f84817', 'db2f32ab-8e69-4622-bc98-ea9a61d516c8', 'cf41aaf5-ecb0-4b42-a3ca-ac7f04e3aae7', '359d9d9c-bf8a-4bae-b95d-e60e13561703'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:10:42 user cinder-volume[73403]: INFO cinder.volume.manager [None req-5c431288-cdfe-46f5-831a-00d66142f479 tempest-VolumesSnapshotTestJSON-423841644 None] Delete snapshot completed successfully. Apr 14 03:10:42 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5c431288-cdfe-46f5-831a-00d66142f479 tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-adc7ede1-9c99-45bb-a117-6023c2cd37ee-delete_snapshot" released by "delete_snapshot" :: held 2.307s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:10:43 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ae2695e5-e8d9-42a2-87a1-30b2397506e0 tempest-VolumesSnapshotTestJSON-423841644 None] Acquiring lock "cinder-b60b4c66-697e-4911-ba4a-68cf47ccaa1b-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:10:43 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ae2695e5-e8d9-42a2-87a1-30b2397506e0 tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-b60b4c66-697e-4911-ba4a-68cf47ccaa1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:10:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ae2695e5-e8d9-42a2-87a1-30b2397506e0 tempest-VolumesSnapshotTestJSON-423841644 None] deleating snapshot s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:10:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae2695e5-e8d9-42a2-87a1-30b2397506e0 tempest-VolumesSnapshotTestJSON-423841644 None] get snapshots for volume s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:10:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae2695e5-e8d9-42a2-87a1-30b2397506e0 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae2695e5-e8d9-42a2-87a1-30b2397506e0 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae2695e5-e8d9-42a2-87a1-30b2397506e0 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae2695e5-e8d9-42a2-87a1-30b2397506e0 tempest-VolumesSnapshotTestJSON-423841644 None] get volume s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:10:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae2695e5-e8d9-42a2-87a1-30b2397506e0 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae2695e5-e8d9-42a2-87a1-30b2397506e0 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae2695e5-e8d9-42a2-87a1-30b2397506e0 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f@s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443240', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '113232', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9502410944060005159', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6d775b4eb63de84d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276102144', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84686', 'name': 's_b60b4c66-697e-4911-ba4a-68cf47ccaa1b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae2695e5-e8d9-42a2-87a1-30b2397506e0 tempest-VolumesSnapshotTestJSON-423841644 None] delete snapshot s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b of volume v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:10:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae2695e5-e8d9-42a2-87a1-30b2397506e0 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots/s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae2695e5-e8d9-42a2-87a1-30b2397506e0 tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots/s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae2695e5-e8d9-42a2-87a1-30b2397506e0 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots/s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae2695e5-e8d9-42a2-87a1-30b2397506e0 tempest-VolumesSnapshotTestJSON-423841644 None] snapshot s_b60b4c66-697e-4911-ba4a-68cf47ccaa1b deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:10:45 user cinder-volume[73403]: DEBUG cinder.quota [None req-ae2695e5-e8d9-42a2-87a1-30b2397506e0 tempest-VolumesSnapshotTestJSON-423841644 None] Created reservations ['8b3712a4-3082-42a1-b8be-8e6bdfafe679', 'cbbeff40-7dfd-4e8d-a503-00b237ea484a', 'e3923d96-da61-4cd1-b517-73986fe1f8ab', '242e3344-e98d-4210-a943-4e84021db32f'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:10:45 user cinder-volume[73403]: INFO cinder.volume.manager [None req-ae2695e5-e8d9-42a2-87a1-30b2397506e0 tempest-VolumesSnapshotTestJSON-423841644 None] Delete snapshot completed successfully. Apr 14 03:10:45 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ae2695e5-e8d9-42a2-87a1-30b2397506e0 tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-b60b4c66-697e-4911-ba4a-68cf47ccaa1b-delete_snapshot" released by "delete_snapshot" :: held 2.302s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:10:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 req-fcd1aa7b-9b37-4a18-9769-74af877bf65b tempest-VolumesSnapshotTestJSON-423841644 None] terminate connection for a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:10:47 user cinder-volume[73403]: INFO cinder.volume.manager [req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 req-fcd1aa7b-9b37-4a18-9769-74af877bf65b tempest-VolumesSnapshotTestJSON-423841644 None] Terminate volume connection completed successfully. Apr 14 03:10:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 req-fcd1aa7b-9b37-4a18-9769-74af877bf65b tempest-VolumesSnapshotTestJSON-423841644 None] Deleting attachment 57342732-1f05-437e-8055-2bd938640127. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:10:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 req-fcd1aa7b-9b37-4a18-9769-74af877bf65b tempest-VolumesSnapshotTestJSON-423841644 None] remove_export for volume: a2998d0d-9ff4-4d46-a62f-30f7df32be1f. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:10:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 req-fcd1aa7b-9b37-4a18-9769-74af877bf65b tempest-VolumesSnapshotTestJSON-423841644 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:10:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 req-fcd1aa7b-9b37-4a18-9769-74af877bf65b tempest-VolumesSnapshotTestJSON-423841644 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1131482370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a2998d0d-9ff4-4d46-a62f-30f7df32be1f,launched_at=2023-04-14T03:08:27Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='4549f6080dcf4c739ac03ef643801fbc',provider_auth='CHAP ZzhfkMEd 0ekL7wqvcMg3f1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:08:24Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:10:47Z,use_quota=True,user_id='0128a733bd6a4120addba5eda1cc05fb',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:10:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 req-fcd1aa7b-9b37-4a18-9769-74af877bf65b tempest-VolumesSnapshotTestJSON-423841644 None] detach volume v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f from target iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:10:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 req-fcd1aa7b-9b37-4a18-9769-74af877bf65b tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f/luns/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 req-fcd1aa7b-9b37-4a18-9769-74af877bf65b tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f/luns/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 req-fcd1aa7b-9b37-4a18-9769-74af877bf65b tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f/luns/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 req-fcd1aa7b-9b37-4a18-9769-74af877bf65b tempest-VolumesSnapshotTestJSON-423841644 None] delete target: iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:10:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 req-fcd1aa7b-9b37-4a18-9769-74af877bf65b tempest-VolumesSnapshotTestJSON-423841644 None] delete target iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:10:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 req-fcd1aa7b-9b37-4a18-9769-74af877bf65b tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 req-fcd1aa7b-9b37-4a18-9769-74af877bf65b tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 req-fcd1aa7b-9b37-4a18-9769-74af877bf65b tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b05a1aab-89ba-40e9-a0ee-e33539da9e76 req-fcd1aa7b-9b37-4a18-9769-74af877bf65b tempest-VolumesSnapshotTestJSON-423841644 None] target iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:10:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] create export for volume: c6fbfee2-70fa-477a-a761-8d092061e691. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:10:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] ensure volume c6fbfee2-70fa-477a-a761-8d092061e691 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:10:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] check if targe iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:10:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] create target and attach volume c6fbfee2-70fa-477a-a761-8d092061e691 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:10:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] create target iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:10:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] atach volume v_c6fbfee2-70fa-477a-a761-8d092061e691 to target iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:10:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3433326361643831', 'lun': 0, 'mode': 'wt', 'name': 'v_c6fbfee2-70fa-477a-a761-8d092061e691', 'prod_id': 'Storage', 'scsi_id': '432cad81504b77c1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] add credentails to target iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:10:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:10:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:10:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': {'name': 'tekamKoO'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:10:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] initialize_connection for c6fbfee2-70fa-477a-a761-8d092061e691 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:10:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tekamKoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '3f82a8e5-bedd-4384-b5b2-6a269185f6a0'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:10:56 user cinder-volume[73403]: INFO cinder.volume.manager [req-aac587f1-4dac-46f8-94ba-8ef0716b3dfe req-83f8d0c6-e007-4606-ba65-92d49d39861c tempest-TestVolumeBootPattern-910285030 None] attachment_update completed successfully. Apr 14 03:11:02 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=57,cinder:UPDATE=20,cinder:INSERT=14 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:11:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:11:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:11:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:11:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276114432', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:11:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:11:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:DELETE=1,cinder:SELECT=50,cinder:INSERT=7,cinder:UPDATE=22 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:11:30 user cinder-volume[73403]: DEBUG cinder.coordination [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Acquiring lock "cinder-4ab737c6-db1d-4122-beea-9f6938803b8a-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:11:30 user cinder-volume[73403]: DEBUG cinder.coordination [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Lock "cinder-4ab737c6-db1d-4122-beea-9f6938803b8a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:11:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] remove_export for volume: 4ab737c6-db1d-4122-beea-9f6938803b8a. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:11:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:11:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1962594783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4ab737c6-db1d-4122-beea-9f6938803b8a,launched_at=2023-04-14T03:10:22Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130665008cf648cf87467ae2777a9170',provider_auth='CHAP DMJkXsZY Yo9PJHyeAOTqLi',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:10:21Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:11:31Z,updated_at=2023-04-14T03:11:31Z,use_quota=True,user_id='d6d78d4991b5493e8893034e91ed407b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:11:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] detach volume v_4ab737c6-db1d-4122-beea-9f6938803b8a from target iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:11:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a/luns/v_4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a/luns/v_4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a/luns/v_4ab737c6-db1d-4122-beea-9f6938803b8a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a/luns/v_4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] failed to remove resource iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a because of JDSS resource v_4ab737c6-db1d-4122-beea-9f6938803b8a DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:11:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] delete target: iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:11:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] delete target iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:11:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] failed to remove resource iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a because of JDSS resource iqn.2010-10.org.openstack:4ab737c6-db1d-4122-beea-9f6938803b8a DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:11:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] deleating volume v_4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:11:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] get snapshots for volume v_4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:11:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4ab737c6-db1d-4122-beea-9f6938803b8a/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4ab737c6-db1d-4122-beea-9f6938803b8a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4ab737c6-db1d-4122-beea-9f6938803b8a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] get volume v_4ab737c6-db1d-4122-beea-9f6938803b8a info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:11:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4ab737c6-db1d-4122-beea-9f6938803b8a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443230', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113208', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6255487000233928826', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4d97069fa92643af', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276110336', 'san:volume_id': '4d97069fa92643af5b61626b8ce09ef47cf5ed6a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85944', 'name': 'v_4ab737c6-db1d-4122-beea-9f6938803b8a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] delete volume:v_4ab737c6-db1d-4122-beea-9f6938803b8a recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:11:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5fac981a-162e-453b-87d0-6cfc008f053d req-5ee92a69-2398-4c69-8c69-4f5be52d8998 tempest-ServerActionsTestJSON-1848627478 None] terminate connection for 44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:11:32 user cinder-volume[73403]: INFO cinder.volume.manager [req-5fac981a-162e-453b-87d0-6cfc008f053d req-5ee92a69-2398-4c69-8c69-4f5be52d8998 tempest-ServerActionsTestJSON-1848627478 None] Terminate volume connection completed successfully. Apr 14 03:11:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-5fac981a-162e-453b-87d0-6cfc008f053d req-5ee92a69-2398-4c69-8c69-4f5be52d8998 tempest-ServerActionsTestJSON-1848627478 None] Deleting attachment dc1ebff7-3718-4344-8f48-15d70c443eac. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:11:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5fac981a-162e-453b-87d0-6cfc008f053d req-5ee92a69-2398-4c69-8c69-4f5be52d8998 tempest-ServerActionsTestJSON-1848627478 None] remove_export for volume: 44f3cbc9-fd81-4185-aa74-0896739af983. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:11:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5fac981a-162e-453b-87d0-6cfc008f053d req-5ee92a69-2398-4c69-8c69-4f5be52d8998 tempest-ServerActionsTestJSON-1848627478 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:11:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5fac981a-162e-453b-87d0-6cfc008f053d req-5ee92a69-2398-4c69-8c69-4f5be52d8998 tempest-ServerActionsTestJSON-1848627478 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-368917324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=44f3cbc9-fd81-4185-aa74-0896739af983,launched_at=2023-04-14T03:06:39Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='4075885e26cb4adaad24d3ae6217fe35',provider_auth='CHAP rCsYcqle dmt65IHyECkAD0',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:06:38Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:08:55Z,use_quota=True,user_id='7dea23743ba945c4a9d539b8e277c653',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:11:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5fac981a-162e-453b-87d0-6cfc008f053d req-5ee92a69-2398-4c69-8c69-4f5be52d8998 tempest-ServerActionsTestJSON-1848627478 None] detach volume v_44f3cbc9-fd81-4185-aa74-0896739af983 from target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:11:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5fac981a-162e-453b-87d0-6cfc008f053d req-5ee92a69-2398-4c69-8c69-4f5be52d8998 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns/v_44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5fac981a-162e-453b-87d0-6cfc008f053d req-5ee92a69-2398-4c69-8c69-4f5be52d8998 tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns/v_44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5fac981a-162e-453b-87d0-6cfc008f053d req-5ee92a69-2398-4c69-8c69-4f5be52d8998 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns/v_44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5fac981a-162e-453b-87d0-6cfc008f053d req-5ee92a69-2398-4c69-8c69-4f5be52d8998 tempest-ServerActionsTestJSON-1848627478 None] delete target: iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:11:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5fac981a-162e-453b-87d0-6cfc008f053d req-5ee92a69-2398-4c69-8c69-4f5be52d8998 tempest-ServerActionsTestJSON-1848627478 None] delete target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:11:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5fac981a-162e-453b-87d0-6cfc008f053d req-5ee92a69-2398-4c69-8c69-4f5be52d8998 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5fac981a-162e-453b-87d0-6cfc008f053d req-5ee92a69-2398-4c69-8c69-4f5be52d8998 tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5fac981a-162e-453b-87d0-6cfc008f053d req-5ee92a69-2398-4c69-8c69-4f5be52d8998 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5fac981a-162e-453b-87d0-6cfc008f053d req-5ee92a69-2398-4c69-8c69-4f5be52d8998 tempest-ServerActionsTestJSON-1848627478 None] target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:11:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4ab737c6-db1d-4122-beea-9f6938803b8a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] volume v_4ab737c6-db1d-4122-beea-9f6938803b8a deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:11:33 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=15,cinder:UPDATE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:11:33 user cinder-volume[73403]: DEBUG cinder.quota [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Created reservations ['0fc934d6-e30f-4c85-abb0-b613bf68ced2', 'c19eaacd-3d23-441a-ada2-75245b124c47', '33eede75-df50-43b0-b644-f537eb13b581', '192da11d-746e-4aec-a7dd-4d8492357ca2'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:11:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:11:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:11:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276192256', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.manager [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:11:34 user cinder-volume[73403]: INFO cinder.volume.manager [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Deleted volume successfully. Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.coordination [None req-2ef61dbf-12fd-4b22-90bf-ed5cc59b2910 tempest-AttachVolumeTestJSON-975876676 None] Lock "cinder-4ab737c6-db1d-4122-beea-9f6938803b8a-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Acquiring lock "cinder-d036730b-83f8-4181-bc64-2c80ee0e312f-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Lock "cinder-d036730b-83f8-4181-bc64-2c80ee0e312f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] remove_export for volume: d036730b-83f8-4181-bc64-2c80ee0e312f. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1739499124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d036730b-83f8-4181-bc64-2c80ee0e312f,launched_at=2023-04-14T03:10:11Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130665008cf648cf87467ae2777a9170',provider_auth='CHAP TEzqAxBi xUGyEhOmXPBbia',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:10:10Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:11:34Z,updated_at=2023-04-14T03:11:34Z,use_quota=True,user_id='d6d78d4991b5493e8893034e91ed407b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] detach volume v_d036730b-83f8-4181-bc64-2c80ee0e312f from target iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f/luns/v_d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f/luns/v_d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f/luns/v_d036730b-83f8-4181-bc64-2c80ee0e312f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f/luns/v_d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] failed to remove resource iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f because of JDSS resource v_d036730b-83f8-4181-bc64-2c80ee0e312f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] delete target: iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] delete target iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] failed to remove resource iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f because of JDSS resource iqn.2010-10.org.openstack:d036730b-83f8-4181-bc64-2c80ee0e312f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] deleating volume v_d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] get snapshots for volume v_d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d036730b-83f8-4181-bc64-2c80ee0e312f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d036730b-83f8-4181-bc64-2c80ee0e312f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d036730b-83f8-4181-bc64-2c80ee0e312f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] get volume v_d036730b-83f8-4181-bc64-2c80ee0e312f info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d036730b-83f8-4181-bc64-2c80ee0e312f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443220', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113196', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5082249882428233923', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a1f8a819f367f44f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276192256', 'san:volume_id': 'a1f8a819f367f44f2e0de137e7664e67567bc8d3', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86046', 'name': 'v_d036730b-83f8-4181-bc64-2c80ee0e312f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] delete volume:v_d036730b-83f8-4181-bc64-2c80ee0e312f recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d036730b-83f8-4181-bc64-2c80ee0e312f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] volume v_d036730b-83f8-4181-bc64-2c80ee0e312f deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:11:36 user cinder-volume[73403]: DEBUG cinder.quota [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Created reservations ['bb1a058d-373d-42b0-a4d0-85a45232ea12', 'b3f79f30-db35-41bd-bacb-5cae69cabcfe', 'c429e705-146d-4326-a338-de395951ece5', 'fa19a809-4fe5-443c-b50f-7a82164ec042'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:11:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:11:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:11:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Acquiring lock "cinder-a2998d0d-9ff4-4d46-a62f-30f7df32be1f-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-a2998d0d-9ff4-4d46-a62f-30f7df32be1f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] remove_export for volume: a2998d0d-9ff4-4d46-a62f-30f7df32be1f. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1131482370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a2998d0d-9ff4-4d46-a62f-30f7df32be1f,launched_at=2023-04-14T03:08:27Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4549f6080dcf4c739ac03ef643801fbc',provider_auth='CHAP ZzhfkMEd 0ekL7wqvcMg3f1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:08:24Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:11:37Z,updated_at=2023-04-14T03:11:37Z,use_quota=True,user_id='0128a733bd6a4120addba5eda1cc05fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] detach volume v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f from target iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f/luns/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f/luns/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f/luns/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f/luns/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] failed to remove resource iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f because of JDSS resource v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] delete target: iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] delete target iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] failed to remove resource iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f because of JDSS resource iqn.2010-10.org.openstack:a2998d0d-9ff4-4d46-a62f-30f7df32be1f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] deleating volume v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] get snapshots for volume v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276286464', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.manager [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:11:37 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Deleted volume successfully. Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a7475e3f-05c7-4ab9-817e-dbe92cf62ee5 tempest-AttachVolumeTestJSON-975876676 None] Lock "cinder-d036730b-83f8-4181-bc64-2c80ee0e312f-delete_volume" released by "delete_volume" :: held 3.090s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Acquiring lock "cinder-d1ac2d2b-c18f-4958-a86e-fa298a15c9b8-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Lock "cinder-d1ac2d2b-c18f-4958-a86e-fa298a15c9b8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] get volume v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] remove_export for volume: d1ac2d2b-c18f-4958-a86e-fa298a15c9b8. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T02:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-197093691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d1ac2d2b-c18f-4958-a86e-fa298a15c9b8,launched_at=2023-04-14T02:59:48Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130665008cf648cf87467ae2777a9170',provider_auth='CHAP mpkibDRE 4JupsCRjwvPz9n',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T02:59:47Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:11:38Z,updated_at=2023-04-14T03:11:38Z,use_quota=True,user_id='d6d78d4991b5493e8893034e91ed407b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] detach volume v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 from target iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8/luns/v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8/luns/v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443114', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '113133', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15939533052635641257', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f72ca3523a4af516', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276286464', 'san:volume_id': 'f72ca3523a4af5165f05e274d1bb33e491b1c425', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86181', 'name': 'v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] delete snapshot v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f of volume v_482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8/luns/v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8/luns/v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] failed to remove resource iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 because of JDSS resource v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] delete target: iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] delete target iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] failed to remove resource iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 because of JDSS resource iqn.2010-10.org.openstack:d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] deleating volume v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] get snapshots for volume v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] get volume v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:11:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442597', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112720', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '678331123138535523', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5127f8eb1709433a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276286464', 'san:volume_id': '5127f8eb1709433acf1acab96c7d4bd50fdcf220', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85560', 'name': 'v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] delete volume:v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:11:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] snapshot v_a2998d0d-9ff4-4d46-a62f-30f7df32be1f deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:11:39 user cinder-volume[73403]: DEBUG cinder.quota [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Created reservations ['8138b9da-973a-44fc-88fd-02d7381f9be8', '60dabce6-03b7-48a8-9c13-4e8d7fab3694', '8ea4369c-98ec-4eac-9376-526c6ddf5ee0', 'cd02ef46-b2b5-46b1-bc6c-c5fcb64554d6'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:11:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:11:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:11:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] volume v_d1ac2d2b-c18f-4958-a86e-fa298a15c9b8 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:11:40 user cinder-volume[73403]: DEBUG cinder.quota [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Created reservations ['884f4788-bf60-424a-adb3-45ffc52a9c9a', '36614ccc-63e4-4be8-8661-deb66e557b60', '81a80b61-da32-4de3-947f-8e5ee376286c', '8b6233c8-9b3e-4606-ac35-d3ca40ed6a1d'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:11:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:11:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:11:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276286464', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:11:40 user cinder-volume[73403]: DEBUG cinder.manager [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:11:40 user cinder-volume[73403]: INFO cinder.volume.manager [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Deleted volume successfully. Apr 14 03:11:40 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e154bd73-674b-4c15-82c5-a49c8299aba7 tempest-AttachVolumeTestJSON-975876676 None] Lock "cinder-d1ac2d2b-c18f-4958-a86e-fa298a15c9b8-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:11:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276429824', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:11:40 user cinder-volume[73403]: DEBUG cinder.manager [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:11:40 user cinder-volume[73403]: INFO cinder.volume.manager [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Deleted volume successfully. Apr 14 03:11:40 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c6543109-3f87-439c-a6cf-e1fda95b4c7d tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-a2998d0d-9ff4-4d46-a62f-30f7df32be1f-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:11:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6112edaf-5767-41d3-bf6c-c5a851b84f7a tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot 95ea838d-5d5d-40a8-98b0-5398b2ef52b6 for volume eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:11:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6112edaf-5767-41d3-bf6c-c5a851b84f7a tempest-VolumesSnapshotTestJSON-423841644 None] cloning v_eb69c0bd-af4f-438c-b96a-94c59261813a to s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:11:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6112edaf-5767-41d3-bf6c-c5a851b84f7a tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:11:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6112edaf-5767-41d3-bf6c-c5a851b84f7a tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6112edaf-5767-41d3-bf6c-c5a851b84f7a tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6112edaf-5767-41d3-bf6c-c5a851b84f7a tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_95ea838d-5d5d-40a8-98b0-5398b2ef52b6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6112edaf-5767-41d3-bf6c-c5a851b84f7a tempest-VolumesSnapshotTestJSON-423841644 None] create volume s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6 from snapshot s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:11:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6112edaf-5767-41d3-bf6c-c5a851b84f7a tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6112edaf-5767-41d3-bf6c-c5a851b84f7a tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6112edaf-5767-41d3-bf6c-c5a851b84f7a tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_eb69c0bd-af4f-438c-b96a-94c59261813a@s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6', 'is_clone': True, 'full_name': 'Pool-0/s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6', 'name': 's_95ea838d-5d5d-40a8-98b0-5398b2ef52b6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6112edaf-5767-41d3-bf6c-c5a851b84f7a tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6112edaf-5767-41d3-bf6c-c5a851b84f7a tempest-VolumesSnapshotTestJSON-423841644 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6112edaf-5767-41d3-bf6c-c5a851b84f7a tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6112edaf-5767-41d3-bf6c-c5a851b84f7a tempest-VolumesSnapshotTestJSON-423841644 None] volume s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:11:43 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=51,cinder:UPDATE=37,cinder:INSERT=6,cinder:DELETE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:11:43 user cinder-volume[73403]: INFO cinder.volume.manager [None req-6112edaf-5767-41d3-bf6c-c5a851b84f7a tempest-VolumesSnapshotTestJSON-423841644 None] Create snapshot completed successfully Apr 14 03:11:43 user cinder-volume[73403]: DEBUG cinder.coordination [None req-6d5c5269-1ec4-4b13-83e4-83f4b98ea1f3 tempest-VolumesSnapshotTestJSON-423841644 None] Acquiring lock "cinder-95ea838d-5d5d-40a8-98b0-5398b2ef52b6-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:11:43 user cinder-volume[73403]: DEBUG cinder.coordination [None req-6d5c5269-1ec4-4b13-83e4-83f4b98ea1f3 tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-95ea838d-5d5d-40a8-98b0-5398b2ef52b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:11:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6d5c5269-1ec4-4b13-83e4-83f4b98ea1f3 tempest-VolumesSnapshotTestJSON-423841644 None] deleating snapshot s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:11:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6d5c5269-1ec4-4b13-83e4-83f4b98ea1f3 tempest-VolumesSnapshotTestJSON-423841644 None] get snapshots for volume s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:11:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d5c5269-1ec4-4b13-83e4-83f4b98ea1f3 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d5c5269-1ec4-4b13-83e4-83f4b98ea1f3 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d5c5269-1ec4-4b13-83e4-83f4b98ea1f3 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6d5c5269-1ec4-4b13-83e4-83f4b98ea1f3 tempest-VolumesSnapshotTestJSON-423841644 None] get volume s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:11:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d5c5269-1ec4-4b13-83e4-83f4b98ea1f3 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d5c5269-1ec4-4b13-83e4-83f4b98ea1f3 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d5c5269-1ec4-4b13-83e4-83f4b98ea1f3 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_eb69c0bd-af4f-438c-b96a-94c59261813a@s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443311', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113275', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8801993589604013785', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6f8b651895ff7ab9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276417536', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85962', 'name': 's_95ea838d-5d5d-40a8-98b0-5398b2ef52b6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6d5c5269-1ec4-4b13-83e4-83f4b98ea1f3 tempest-VolumesSnapshotTestJSON-423841644 None] delete snapshot s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6 of volume v_eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:11:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d5c5269-1ec4-4b13-83e4-83f4b98ea1f3 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots/s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d5c5269-1ec4-4b13-83e4-83f4b98ea1f3 tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots/s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6d5c5269-1ec4-4b13-83e4-83f4b98ea1f3 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots/s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6d5c5269-1ec4-4b13-83e4-83f4b98ea1f3 tempest-VolumesSnapshotTestJSON-423841644 None] snapshot s_95ea838d-5d5d-40a8-98b0-5398b2ef52b6 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:11:46 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=56,cinder:INSERT=10,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:11:46 user cinder-volume[73403]: DEBUG cinder.quota [None req-6d5c5269-1ec4-4b13-83e4-83f4b98ea1f3 tempest-VolumesSnapshotTestJSON-423841644 None] Created reservations ['eb65b099-c09f-455d-bfb9-69b1dee6ec80', '0ccd070e-5c5f-40fa-83ca-3dec93218e31', 'f96bd117-cab5-4d3d-8bf9-d5846c6529ad', 'cac63053-1de8-44f2-b021-3dbed1747324'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:11:46 user cinder-volume[73403]: INFO cinder.volume.manager [None req-6d5c5269-1ec4-4b13-83e4-83f4b98ea1f3 tempest-VolumesSnapshotTestJSON-423841644 None] Delete snapshot completed successfully. Apr 14 03:11:46 user cinder-volume[73403]: DEBUG cinder.coordination [None req-6d5c5269-1ec4-4b13-83e4-83f4b98ea1f3 tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-95ea838d-5d5d-40a8-98b0-5398b2ef52b6-delete_snapshot" released by "delete_snapshot" :: held 2.550s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:11:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf79ab48-a8dc-4ac7-bead-fcbcdca82c13 tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot 4baed33f-013a-45e2-b4bf-36add0ac5c86 for volume eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:11:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf79ab48-a8dc-4ac7-bead-fcbcdca82c13 tempest-VolumesSnapshotTestJSON-423841644 None] cloning v_eb69c0bd-af4f-438c-b96a-94c59261813a to s_4baed33f-013a-45e2-b4bf-36add0ac5c86 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:11:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf79ab48-a8dc-4ac7-bead-fcbcdca82c13 tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot s_4baed33f-013a-45e2-b4bf-36add0ac5c86 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:11:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf79ab48-a8dc-4ac7-bead-fcbcdca82c13 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf79ab48-a8dc-4ac7-bead-fcbcdca82c13 tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf79ab48-a8dc-4ac7-bead-fcbcdca82c13 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_4baed33f-013a-45e2-b4bf-36add0ac5c86'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf79ab48-a8dc-4ac7-bead-fcbcdca82c13 tempest-VolumesSnapshotTestJSON-423841644 None] create volume s_4baed33f-013a-45e2-b4bf-36add0ac5c86 from snapshot s_4baed33f-013a-45e2-b4bf-36add0ac5c86 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:11:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf79ab48-a8dc-4ac7-bead-fcbcdca82c13 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf79ab48-a8dc-4ac7-bead-fcbcdca82c13 tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf79ab48-a8dc-4ac7-bead-fcbcdca82c13 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_eb69c0bd-af4f-438c-b96a-94c59261813a@s_4baed33f-013a-45e2-b4bf-36add0ac5c86', 'is_clone': True, 'full_name': 'Pool-0/s_4baed33f-013a-45e2-b4bf-36add0ac5c86', 'name': 's_4baed33f-013a-45e2-b4bf-36add0ac5c86'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf79ab48-a8dc-4ac7-bead-fcbcdca82c13 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4baed33f-013a-45e2-b4bf-36add0ac5c86/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf79ab48-a8dc-4ac7-bead-fcbcdca82c13 tempest-VolumesSnapshotTestJSON-423841644 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4baed33f-013a-45e2-b4bf-36add0ac5c86/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf79ab48-a8dc-4ac7-bead-fcbcdca82c13 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4baed33f-013a-45e2-b4bf-36add0ac5c86/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf79ab48-a8dc-4ac7-bead-fcbcdca82c13 tempest-VolumesSnapshotTestJSON-423841644 None] volume s_4baed33f-013a-45e2-b4bf-36add0ac5c86 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:11:49 user cinder-volume[73403]: INFO cinder.volume.manager [None req-bf79ab48-a8dc-4ac7-bead-fcbcdca82c13 tempest-VolumesSnapshotTestJSON-423841644 None] Create snapshot completed successfully Apr 14 03:11:52 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:11:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Flow 'volume_create_manager' (3f9f8e6b-6d56-4e7a-aed1-b55ba0f26771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:11:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f723c108-31e8-4f61-a772-0b2101e7e565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:11:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f723c108-31e8-4f61-a772-0b2101e7e565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1590697103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e096d5b7-6d98-471a-98a5-797111a8c47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff14cfb0bae6410ca40294a774d919e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:11:52Z,use_quota=True,user_id='7253223276b54047a7ea19813bb3a9fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:11:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe5c324-6abf-4ca2-8f42-27e7e980aa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:11:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe5c324-6abf-4ca2-8f42-27e7e980aa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:11:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc8e47e-bd08-4d3e-89a3-e9aecb2916cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:11:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc8e47e-bd08-4d3e-89a3-e9aecb2916cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e096d5b7-6d98-471a-98a5-797111a8c47d', 'volume_name': 'volume-e096d5b7-6d98-471a-98a5-797111a8c47d', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:11:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4865483-7de5-4f9b-8005-960313c35a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:11:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4865483-7de5-4f9b-8005-960313c35a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:11:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26a5839-f6e1-450a-b74c-585f0c7c103e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:11:52 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Volume e096d5b7-6d98-471a-98a5-797111a8c47d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e096d5b7-6d98-471a-98a5-797111a8c47d', 'volume_size': 1} Apr 14 03:11:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] creating volume v_e096d5b7-6d98-471a-98a5-797111a8c47d. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:11:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] create volume {'name': 'v_e096d5b7-6d98-471a-98a5-797111a8c47d', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:11:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e096d5b7-6d98-471a-98a5-797111a8c47d', 'is_clone': False, 'name': 'v_e096d5b7-6d98-471a-98a5-797111a8c47d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26a5839-f6e1-450a-b74c-585f0c7c103e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e096d5b7-6d98-471a-98a5-797111a8c47d', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6200537c-fd5c-4f07-a441-bae5db5779da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:11:53 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Volume volume-e096d5b7-6d98-471a-98a5-797111a8c47d (e096d5b7-6d98-471a-98a5-797111a8c47d): created successfully Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6200537c-fd5c-4f07-a441-bae5db5779da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Flow 'volume_create_manager' (3f9f8e6b-6d56-4e7a-aed1-b55ba0f26771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:11:53 user cinder-volume[73403]: INFO cinder.volume.manager [None req-f6629766-4942-401c-aba1-2db7097e8698 tempest-VolumeQuotasAdminTestJSON-1566180371 None] Created volume successfully. Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.coordination [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Acquiring lock "cinder-e096d5b7-6d98-471a-98a5-797111a8c47d-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.coordination [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Lock "cinder-e096d5b7-6d98-471a-98a5-797111a8c47d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] remove_export for volume: e096d5b7-6d98-471a-98a5-797111a8c47d. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1590697103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e096d5b7-6d98-471a-98a5-797111a8c47d,launched_at=2023-04-14T03:11:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff14cfb0bae6410ca40294a774d919e3',provider_auth='CHAP peXELzbG nuvHiyX1m2RDwL',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e096d5b7-6d98-471a-98a5-797111a8c47d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:11:52Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:11:54Z,updated_at=2023-04-14T03:11:54Z,use_quota=True,user_id='7253223276b54047a7ea19813bb3a9fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:e096d5b7-6d98-471a-98a5-797111a8c47d. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] detach volume v_e096d5b7-6d98-471a-98a5-797111a8c47d from target iqn.2010-10.org.openstack:e096d5b7-6d98-471a-98a5-797111a8c47d {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e096d5b7-6d98-471a-98a5-797111a8c47d/luns/v_e096d5b7-6d98-471a-98a5-797111a8c47d {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e096d5b7-6d98-471a-98a5-797111a8c47d/luns/v_e096d5b7-6d98-471a-98a5-797111a8c47d {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e096d5b7-6d98-471a-98a5-797111a8c47d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e096d5b7-6d98-471a-98a5-797111a8c47d/luns/v_e096d5b7-6d98-471a-98a5-797111a8c47d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e096d5b7-6d98-471a-98a5-797111a8c47d/luns/v_e096d5b7-6d98-471a-98a5-797111a8c47d {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] failed to remove resource iqn.2010-10.org.openstack:e096d5b7-6d98-471a-98a5-797111a8c47d because of JDSS resource v_e096d5b7-6d98-471a-98a5-797111a8c47d DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] delete target: iqn.2010-10.org.openstack:e096d5b7-6d98-471a-98a5-797111a8c47d {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] delete target iqn.2010-10.org.openstack:e096d5b7-6d98-471a-98a5-797111a8c47d {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e096d5b7-6d98-471a-98a5-797111a8c47d {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e096d5b7-6d98-471a-98a5-797111a8c47d {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e096d5b7-6d98-471a-98a5-797111a8c47d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e096d5b7-6d98-471a-98a5-797111a8c47d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e096d5b7-6d98-471a-98a5-797111a8c47d {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] failed to remove resource iqn.2010-10.org.openstack:e096d5b7-6d98-471a-98a5-797111a8c47d because of JDSS resource iqn.2010-10.org.openstack:e096d5b7-6d98-471a-98a5-797111a8c47d DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] deleating volume v_e096d5b7-6d98-471a-98a5-797111a8c47d {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] get snapshots for volume v_e096d5b7-6d98-471a-98a5-797111a8c47d {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e096d5b7-6d98-471a-98a5-797111a8c47d/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e096d5b7-6d98-471a-98a5-797111a8c47d/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e096d5b7-6d98-471a-98a5-797111a8c47d/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] get volume v_e096d5b7-6d98-471a-98a5-797111a8c47d info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:11:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e096d5b7-6d98-471a-98a5-797111a8c47d {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e096d5b7-6d98-471a-98a5-797111a8c47d {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e096d5b7-6d98-471a-98a5-797111a8c47d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443322', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113289', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4884879382191694534', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ff08785614947346', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276298752', 'san:volume_id': 'ff08785614947346e70ace7229f88a9006dc3b55', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85994', 'name': 'v_e096d5b7-6d98-471a-98a5-797111a8c47d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e096d5b7-6d98-471a-98a5-797111a8c47d {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] delete volume:v_e096d5b7-6d98-471a-98a5-797111a8c47d recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:11:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e096d5b7-6d98-471a-98a5-797111a8c47d {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e096d5b7-6d98-471a-98a5-797111a8c47d {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e096d5b7-6d98-471a-98a5-797111a8c47d {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] volume v_e096d5b7-6d98-471a-98a5-797111a8c47d deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:11:55 user cinder-volume[73403]: DEBUG cinder.quota [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Created reservations ['c2885dfb-3442-4e81-9e7b-d615e17886b9', '52b42981-e3dd-4bc3-8f1a-d1c4d5730d76', 'ea209422-bff4-467d-9265-e709dcd8706d', '20e3f916-ac8d-4838-bf3c-5019c41731cd'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:11:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:11:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:11:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276392960', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:11:56 user cinder-volume[73403]: DEBUG cinder.manager [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:11:56 user cinder-volume[73403]: INFO cinder.volume.manager [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Deleted volume successfully. Apr 14 03:11:56 user cinder-volume[73403]: DEBUG cinder.coordination [None req-3a09d1dd-ee80-4a7d-8244-e896a0cf064e tempest-VolumeQuotasAdminTestJSON-1566180371 None] Lock "cinder-e096d5b7-6d98-471a-98a5-797111a8c47d-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:11:57 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:11:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Flow 'volume_create_manager' (888433b2-468c-44f1-942f-a30078c0fc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:11:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6599b17-1ea3-4011-b463-6d000e30916b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:11:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6599b17-1ea3-4011-b463-6d000e30916b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-428639756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=bc515144-c387-4ea4-b9c4-a8e9d56bd79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff14cfb0bae6410ca40294a774d919e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:11:57Z,use_quota=True,user_id='7253223276b54047a7ea19813bb3a9fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:11:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549d2257-c230-40ad-8723-f7170a9ac90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:11:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549d2257-c230-40ad-8723-f7170a9ac90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:11:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (266b0f3c-1d38-4c5c-b42f-df4a3aeb4d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:11:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (266b0f3c-1d38-4c5c-b42f-df4a3aeb4d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc515144-c387-4ea4-b9c4-a8e9d56bd79a', 'volume_name': 'volume-bc515144-c387-4ea4-b9c4-a8e9d56bd79a', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:11:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1455d75-bca2-458f-ac99-032dbfc9b917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:11:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1455d75-bca2-458f-ac99-032dbfc9b917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:11:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5032a1c9-4e4b-463b-9e86-1653daa70c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:11:57 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Volume bc515144-c387-4ea4-b9c4-a8e9d56bd79a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc515144-c387-4ea4-b9c4-a8e9d56bd79a', 'volume_size': 1} Apr 14 03:11:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] creating volume v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:11:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] create volume {'name': 'v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:11:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:11:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:11:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a', 'is_clone': False, 'name': 'v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:11:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5032a1c9-4e4b-463b-9e86-1653daa70c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc515144-c387-4ea4-b9c4-a8e9d56bd79a', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:11:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a00afae5-de24-47a5-aa3f-5065075b90a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:11:58 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Volume volume-bc515144-c387-4ea4-b9c4-a8e9d56bd79a (bc515144-c387-4ea4-b9c4-a8e9d56bd79a): created successfully Apr 14 03:11:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a00afae5-de24-47a5-aa3f-5065075b90a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:11:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Flow 'volume_create_manager' (888433b2-468c-44f1-942f-a30078c0fc82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:11:58 user cinder-volume[73403]: INFO cinder.volume.manager [None req-425b9a62-2d60-4722-b20f-a505c1bb0e4a tempest-VolumeQuotasAdminTestJSON-1566180371 None] Created volume successfully. Apr 14 03:11:59 user cinder-volume[73403]: INFO cinder.volume.manager [None req-2682ebbc-9315-4841-9561-1a6d8468df91 tempest-VolumeQuotasAdminTestJSON-1170945602 None] Transfer volume completed successfully. Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Acquiring lock "cinder-bc515144-c387-4ea4-b9c4-a8e9d56bd79a-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Lock "cinder-bc515144-c387-4ea4-b9c4-a8e9d56bd79a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] remove_export for volume: bc515144-c387-4ea4-b9c4-a8e9d56bd79a. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-428639756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=bc515144-c387-4ea4-b9c4-a8e9d56bd79a,launched_at=2023-04-14T03:11:58Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fabe98fc00a413ab1e71cfed3133d87',provider_auth='CHAP AqksivQE T8dPhWjxcvnsDN',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc515144-c387-4ea4-b9c4-a8e9d56bd79a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:11:57Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:12:00Z,updated_at=2023-04-14T03:12:00Z,use_quota=True,user_id='7f92892cd76f4578a3161b0ceab44cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:bc515144-c387-4ea4-b9c4-a8e9d56bd79a. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] detach volume v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a from target iqn.2010-10.org.openstack:bc515144-c387-4ea4-b9c4-a8e9d56bd79a {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bc515144-c387-4ea4-b9c4-a8e9d56bd79a/luns/v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bc515144-c387-4ea4-b9c4-a8e9d56bd79a/luns/v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bc515144-c387-4ea4-b9c4-a8e9d56bd79a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bc515144-c387-4ea4-b9c4-a8e9d56bd79a/luns/v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bc515144-c387-4ea4-b9c4-a8e9d56bd79a/luns/v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] failed to remove resource iqn.2010-10.org.openstack:bc515144-c387-4ea4-b9c4-a8e9d56bd79a because of JDSS resource v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] delete target: iqn.2010-10.org.openstack:bc515144-c387-4ea4-b9c4-a8e9d56bd79a {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] delete target iqn.2010-10.org.openstack:bc515144-c387-4ea4-b9c4-a8e9d56bd79a {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bc515144-c387-4ea4-b9c4-a8e9d56bd79a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bc515144-c387-4ea4-b9c4-a8e9d56bd79a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bc515144-c387-4ea4-b9c4-a8e9d56bd79a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bc515144-c387-4ea4-b9c4-a8e9d56bd79a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bc515144-c387-4ea4-b9c4-a8e9d56bd79a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] failed to remove resource iqn.2010-10.org.openstack:bc515144-c387-4ea4-b9c4-a8e9d56bd79a because of JDSS resource iqn.2010-10.org.openstack:bc515144-c387-4ea4-b9c4-a8e9d56bd79a DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] deleating volume v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] get snapshots for volume v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] get volume v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443326', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113294', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '543763451175476384', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ebc51c0fe6d818c5', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276298752', 'san:volume_id': 'ebc51c0fe6d818c53a721bdbd4e637a5804bd3c8', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84696', 'name': 'v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] delete volume:v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] volume v_bc515144-c387-4ea4-b9c4-a8e9d56bd79a deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:12:02 user cinder-volume[73403]: DEBUG cinder.quota [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Created reservations ['d7268444-0ad3-42ab-ba66-0835af6efe12', 'ce69ae3e-3269-47e3-9d5c-d89d85c598d3', '43292b62-90a0-428e-b5d9-d1a8494f111a', 'dbfb6a95-6118-4f94-8be9-15fb64e8679e'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:12:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:12:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:12:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:12:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:12:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:12:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276392960', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:12:03 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:12:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276380672', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:12:03 user cinder-volume[73403]: DEBUG cinder.manager [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:12:03 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Deleted volume successfully. Apr 14 03:12:03 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8edf40f2-e5fe-42fa-b804-d6411be06601 tempest-VolumeQuotasAdminTestJSON-1927467256 None] Lock "cinder-bc515144-c387-4ea4-b9c4-a8e9d56bd79a-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:12:08 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:12:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Flow 'volume_create_manager' (5354030c-ec3e-471c-9a0a-7a977dce7ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:12:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc64596-3a99-4bc9-956a-6a9412f01d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc64596-3a99-4bc9-956a-6a9412f01d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1722762302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=34ea1500-40dd-46c9-a63b-1a880e683009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0476d863fbd4b11b50eefa19a3a2067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:12:09Z,use_quota=True,user_id='9a3fd915161942c1a40e10f8fe9e4899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8841da19-c266-473f-acd1-a0adeb0302f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8841da19-c266-473f-acd1-a0adeb0302f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053fcc91-90d4-4aed-a81b-416a387b0580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053fcc91-90d4-4aed-a81b-416a387b0580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34ea1500-40dd-46c9-a63b-1a880e683009', 'volume_name': 'volume-34ea1500-40dd-46c9-a63b-1a880e683009', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e86907-2902-447a-b103-cf862959bc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e86907-2902-447a-b103-cf862959bc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d04001-a07f-40e5-9aeb-fc998cc426cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:08 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Volume 34ea1500-40dd-46c9-a63b-1a880e683009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34ea1500-40dd-46c9-a63b-1a880e683009', 'volume_size': 1} Apr 14 03:12:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] creating volume v_34ea1500-40dd-46c9-a63b-1a880e683009. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:12:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] create volume {'name': 'v_34ea1500-40dd-46c9-a63b-1a880e683009', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:12:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_34ea1500-40dd-46c9-a63b-1a880e683009', 'is_clone': False, 'name': 'v_34ea1500-40dd-46c9-a63b-1a880e683009'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:09 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=59,cinder:INSERT=8,cinder:UPDATE=30,cinder:DELETE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d04001-a07f-40e5-9aeb-fc998cc426cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34ea1500-40dd-46c9-a63b-1a880e683009', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90b6acd-cfc7-4b6b-8830-84cea616d911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:09 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Volume volume-34ea1500-40dd-46c9-a63b-1a880e683009 (34ea1500-40dd-46c9-a63b-1a880e683009): created successfully Apr 14 03:12:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90b6acd-cfc7-4b6b-8830-84cea616d911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Flow 'volume_create_manager' (5354030c-ec3e-471c-9a0a-7a977dce7ced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:12:09 user cinder-volume[73403]: INFO cinder.volume.manager [None req-d88111b2-f005-4965-a469-0bc6e1c889e2 tempest-VolumesTransfersTest-73169892 None] Created volume successfully. Apr 14 03:12:10 user cinder-volume[73403]: INFO cinder.volume.manager [None req-285a1bf2-86dc-4dd3-b87c-6937e1f0e191 tempest-VolumesTransfersTest-2102890457 None] Transfer volume completed successfully. Apr 14 03:12:10 user cinder-volume[73403]: DEBUG cinder.coordination [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Acquiring lock "cinder-34ea1500-40dd-46c9-a63b-1a880e683009-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:12:10 user cinder-volume[73403]: DEBUG cinder.coordination [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Lock "cinder-34ea1500-40dd-46c9-a63b-1a880e683009-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:12:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] remove_export for volume: 34ea1500-40dd-46c9-a63b-1a880e683009. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:12:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:12:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1722762302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=34ea1500-40dd-46c9-a63b-1a880e683009,launched_at=2023-04-14T03:12:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ddc588825d4eea9b90e6ff72b86e4a',provider_auth='CHAP uYVDnkzA IwrH3UVxZ482jf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:34ea1500-40dd-46c9-a63b-1a880e683009 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:12:09Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:12:11Z,updated_at=2023-04-14T03:12:11Z,use_quota=True,user_id='4774052614684514b82addf877124e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:34ea1500-40dd-46c9-a63b-1a880e683009. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:12:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] detach volume v_34ea1500-40dd-46c9-a63b-1a880e683009 from target iqn.2010-10.org.openstack:34ea1500-40dd-46c9-a63b-1a880e683009 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:12:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34ea1500-40dd-46c9-a63b-1a880e683009/luns/v_34ea1500-40dd-46c9-a63b-1a880e683009 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34ea1500-40dd-46c9-a63b-1a880e683009/luns/v_34ea1500-40dd-46c9-a63b-1a880e683009 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:34ea1500-40dd-46c9-a63b-1a880e683009 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34ea1500-40dd-46c9-a63b-1a880e683009/luns/v_34ea1500-40dd-46c9-a63b-1a880e683009'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34ea1500-40dd-46c9-a63b-1a880e683009/luns/v_34ea1500-40dd-46c9-a63b-1a880e683009 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] failed to remove resource iqn.2010-10.org.openstack:34ea1500-40dd-46c9-a63b-1a880e683009 because of JDSS resource v_34ea1500-40dd-46c9-a63b-1a880e683009 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:12:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] delete target: iqn.2010-10.org.openstack:34ea1500-40dd-46c9-a63b-1a880e683009 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:12:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] delete target iqn.2010-10.org.openstack:34ea1500-40dd-46c9-a63b-1a880e683009 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:12:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34ea1500-40dd-46c9-a63b-1a880e683009 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34ea1500-40dd-46c9-a63b-1a880e683009 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:34ea1500-40dd-46c9-a63b-1a880e683009 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34ea1500-40dd-46c9-a63b-1a880e683009'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34ea1500-40dd-46c9-a63b-1a880e683009 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] failed to remove resource iqn.2010-10.org.openstack:34ea1500-40dd-46c9-a63b-1a880e683009 because of JDSS resource iqn.2010-10.org.openstack:34ea1500-40dd-46c9-a63b-1a880e683009 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:12:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] deleating volume v_34ea1500-40dd-46c9-a63b-1a880e683009 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:12:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] get snapshots for volume v_34ea1500-40dd-46c9-a63b-1a880e683009 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:12:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34ea1500-40dd-46c9-a63b-1a880e683009/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34ea1500-40dd-46c9-a63b-1a880e683009/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34ea1500-40dd-46c9-a63b-1a880e683009/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] get volume v_34ea1500-40dd-46c9-a63b-1a880e683009 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:12:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34ea1500-40dd-46c9-a63b-1a880e683009 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34ea1500-40dd-46c9-a63b-1a880e683009 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_34ea1500-40dd-46c9-a63b-1a880e683009', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443338', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113300', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8411235298383057202', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6d469360d0766eca', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276298752', 'san:volume_id': '6d469360d0766eca0d8cbdec21e8406d3c256e31', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85274', 'name': 'v_34ea1500-40dd-46c9-a63b-1a880e683009', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34ea1500-40dd-46c9-a63b-1a880e683009 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] delete volume:v_34ea1500-40dd-46c9-a63b-1a880e683009 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:12:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34ea1500-40dd-46c9-a63b-1a880e683009 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34ea1500-40dd-46c9-a63b-1a880e683009 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34ea1500-40dd-46c9-a63b-1a880e683009 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] volume v_34ea1500-40dd-46c9-a63b-1a880e683009 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:12:13 user cinder-volume[73403]: DEBUG cinder.quota [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Created reservations ['858c5744-6c50-4376-ad70-9af4b57870c9', '286156a8-e708-41c5-b024-27e774a2de7e', 'aa69b7a3-4f29-4d90-b7e4-2ac34f2f4d17', '15aaad0b-443f-4622-8a40-cec206aaca3c'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:12:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:12:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:12:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276368384', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:12:13 user cinder-volume[73403]: DEBUG cinder.manager [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:12:13 user cinder-volume[73403]: INFO cinder.volume.manager [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Deleted volume successfully. Apr 14 03:12:13 user cinder-volume[73403]: DEBUG cinder.coordination [None req-20e95160-b475-4c08-863c-9da762d552d1 tempest-VolumesTransfersTest-1836508910 None] Lock "cinder-34ea1500-40dd-46c9-a63b-1a880e683009-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:12:14 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:12:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Flow 'volume_create_manager' (aa014f6d-8bb6-4370-bdc1-3f601566f8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:12:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07eb42ea-a13c-4226-a494-ea05a940f39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:14 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=52,cinder:UPDATE=38,cinder:DELETE=4,cinder:INSERT=6 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07eb42ea-a13c-4226-a494-ea05a940f39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-66974622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=bc1f32c8-92eb-4399-a688-8f872006d7dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0476d863fbd4b11b50eefa19a3a2067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:12:15Z,use_quota=True,user_id='9a3fd915161942c1a40e10f8fe9e4899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629614c4-6f49-4cd2-89b0-864edbe5a265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629614c4-6f49-4cd2-89b0-864edbe5a265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8536da-cc0f-4537-8030-6021fee91f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8536da-cc0f-4537-8030-6021fee91f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc1f32c8-92eb-4399-a688-8f872006d7dd', 'volume_name': 'volume-bc1f32c8-92eb-4399-a688-8f872006d7dd', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227f4fa2-e619-42a5-a3a6-e32955682155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227f4fa2-e619-42a5-a3a6-e32955682155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9d9694-6d9d-4d65-9ce6-a16268627144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:14 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Volume bc1f32c8-92eb-4399-a688-8f872006d7dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc1f32c8-92eb-4399-a688-8f872006d7dd', 'volume_size': 1} Apr 14 03:12:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] creating volume v_bc1f32c8-92eb-4399-a688-8f872006d7dd. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:12:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] create volume {'name': 'v_bc1f32c8-92eb-4399-a688-8f872006d7dd', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:12:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 req-dc245213-c845-4410-947b-856275bf8d60 tempest-ServerRescueNegativeTestJSON-773851452 None] terminate connection for 05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:12:15 user cinder-volume[73403]: INFO cinder.volume.manager [req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 req-dc245213-c845-4410-947b-856275bf8d60 tempest-ServerRescueNegativeTestJSON-773851452 None] Terminate volume connection completed successfully. Apr 14 03:12:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 req-dc245213-c845-4410-947b-856275bf8d60 tempest-ServerRescueNegativeTestJSON-773851452 None] Deleting attachment f6acf2ef-4b28-4065-bb47-80775d83e693. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:12:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 req-dc245213-c845-4410-947b-856275bf8d60 tempest-ServerRescueNegativeTestJSON-773851452 None] remove_export for volume: 05d362e8-1aaf-4bbb-8a9f-9f153920e00c. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:12:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 req-dc245213-c845-4410-947b-856275bf8d60 tempest-ServerRescueNegativeTestJSON-773851452 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:12:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 req-dc245213-c845-4410-947b-856275bf8d60 tempest-ServerRescueNegativeTestJSON-773851452 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-509802863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=05d362e8-1aaf-4bbb-8a9f-9f153920e00c,launched_at=2023-04-14T03:06:26Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='558bfd7e1d9049d396381de148b0c4a5',provider_auth='CHAP KcHRlyjP siBXDKM287E9uC',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:06:25Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:12:14Z,use_quota=True,user_id='d5e8150f1502427fb3148f20354d212e',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:12:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 req-dc245213-c845-4410-947b-856275bf8d60 tempest-ServerRescueNegativeTestJSON-773851452 None] detach volume v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c from target iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:12:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 req-dc245213-c845-4410-947b-856275bf8d60 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c/luns/v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 req-dc245213-c845-4410-947b-856275bf8d60 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c/luns/v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 req-dc245213-c845-4410-947b-856275bf8d60 tempest-ServerRescueNegativeTestJSON-773851452 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c/luns/v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 req-dc245213-c845-4410-947b-856275bf8d60 tempest-ServerRescueNegativeTestJSON-773851452 None] delete target: iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:12:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 req-dc245213-c845-4410-947b-856275bf8d60 tempest-ServerRescueNegativeTestJSON-773851452 None] delete target iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:12:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 req-dc245213-c845-4410-947b-856275bf8d60 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 req-dc245213-c845-4410-947b-856275bf8d60 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_bc1f32c8-92eb-4399-a688-8f872006d7dd', 'is_clone': False, 'name': 'v_bc1f32c8-92eb-4399-a688-8f872006d7dd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9d9694-6d9d-4d65-9ce6-a16268627144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc1f32c8-92eb-4399-a688-8f872006d7dd', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce192437-5133-447f-b210-a22197c3e6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:15 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Volume volume-bc1f32c8-92eb-4399-a688-8f872006d7dd (bc1f32c8-92eb-4399-a688-8f872006d7dd): created successfully Apr 14 03:12:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce192437-5133-447f-b210-a22197c3e6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Flow 'volume_create_manager' (aa014f6d-8bb6-4370-bdc1-3f601566f8bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:12:15 user cinder-volume[73403]: INFO cinder.volume.manager [None req-b4b0ae06-ea2c-40e6-9427-1811f507d902 tempest-VolumesTransfersTest-73169892 None] Created volume successfully. Apr 14 03:12:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 req-dc245213-c845-4410-947b-856275bf8d60 tempest-ServerRescueNegativeTestJSON-773851452 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-da18d952-1e93-4b08-bbf1-dcbfd9b84297 req-dc245213-c845-4410-947b-856275bf8d60 tempest-ServerRescueNegativeTestJSON-773851452 None] target iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-03514a15-6336-4393-9a6e-44171d7a4a78 tempest-VolumesActionsTest-121883605 None] Acquiring lock "cinder-117adce3-717a-4664-8cfa-be7d1f5d0169" by "attach_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-03514a15-6336-4393-9a6e-44171d7a4a78 tempest-VolumesActionsTest-121883605 None] Lock "cinder-117adce3-717a-4664-8cfa-be7d1f5d0169" acquired by "attach_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:12:16 user cinder-volume[73403]: INFO cinder.volume.manager [None req-03514a15-6336-4393-9a6e-44171d7a4a78 tempest-VolumesActionsTest-121883605 None] Attaching volume 117adce3-717a-4664-8cfa-be7d1f5d0169 to instance 1840cf40-2228-4506-9a3f-0c9d29373533 at mountpoint /dev/vdb on host None. Apr 14 03:12:16 user cinder-volume[73403]: INFO cinder.volume.manager [None req-03514a15-6336-4393-9a6e-44171d7a4a78 tempest-VolumesActionsTest-121883605 None] Attach volume completed successfully. Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-03514a15-6336-4393-9a6e-44171d7a4a78 tempest-VolumesActionsTest-121883605 None] Lock "cinder-117adce3-717a-4664-8cfa-be7d1f5d0169" released by "attach_volume" :: held 0.073s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c95da568-fe82-4068-b0fe-b567145b4abf tempest-VolumesActionsTest-121883605 None] Acquiring lock "cinder-117adce3-717a-4664-8cfa-be7d1f5d0169-detach_volume" by "detach_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c95da568-fe82-4068-b0fe-b567145b4abf tempest-VolumesActionsTest-121883605 None] Lock "cinder-117adce3-717a-4664-8cfa-be7d1f5d0169-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:12:16 user cinder-volume[73403]: INFO cinder.volume.manager [None req-c95da568-fe82-4068-b0fe-b567145b4abf tempest-VolumesActionsTest-121883605 None] Detaching volume 117adce3-717a-4664-8cfa-be7d1f5d0169 from instance 1840cf40-2228-4506-9a3f-0c9d29373533. Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c95da568-fe82-4068-b0fe-b567145b4abf tempest-VolumesActionsTest-121883605 None] remove_export for volume: 117adce3-717a-4664-8cfa-be7d1f5d0169. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c95da568-fe82-4068-b0fe-b567145b4abf tempest-VolumesActionsTest-121883605 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c95da568-fe82-4068-b0fe-b567145b4abf tempest-VolumesActionsTest-121883605 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-569973521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=117adce3-717a-4664-8cfa-be7d1f5d0169,launched_at=2023-04-14T03:10:24Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1318728a20064d49b9c1b2f89175a364',provider_auth='CHAP jOXbqBQa yUTrKfO7vhBHQz',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:10:23Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:12:17Z,use_quota=True,user_id='b2facbf385e8402c86706cc28d4707af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c95da568-fe82-4068-b0fe-b567145b4abf tempest-VolumesActionsTest-121883605 None] detach volume v_117adce3-717a-4664-8cfa-be7d1f5d0169 from target iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c95da568-fe82-4068-b0fe-b567145b4abf tempest-VolumesActionsTest-121883605 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/luns/v_117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c95da568-fe82-4068-b0fe-b567145b4abf tempest-VolumesActionsTest-121883605 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/luns/v_117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c95da568-fe82-4068-b0fe-b567145b4abf tempest-VolumesActionsTest-121883605 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/luns/v_117adce3-717a-4664-8cfa-be7d1f5d0169'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/luns/v_117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c95da568-fe82-4068-b0fe-b567145b4abf tempest-VolumesActionsTest-121883605 None] failed to remove resource iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 because of JDSS resource v_117adce3-717a-4664-8cfa-be7d1f5d0169 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c95da568-fe82-4068-b0fe-b567145b4abf tempest-VolumesActionsTest-121883605 None] delete target: iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c95da568-fe82-4068-b0fe-b567145b4abf tempest-VolumesActionsTest-121883605 None] delete target iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c95da568-fe82-4068-b0fe-b567145b4abf tempest-VolumesActionsTest-121883605 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c95da568-fe82-4068-b0fe-b567145b4abf tempest-VolumesActionsTest-121883605 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c95da568-fe82-4068-b0fe-b567145b4abf tempest-VolumesActionsTest-121883605 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c95da568-fe82-4068-b0fe-b567145b4abf tempest-VolumesActionsTest-121883605 None] failed to remove resource iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 because of JDSS resource iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:12:16 user cinder-volume[73403]: INFO cinder.volume.manager [None req-c95da568-fe82-4068-b0fe-b567145b4abf tempest-VolumesActionsTest-121883605 None] Detach volume completed successfully. Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c95da568-fe82-4068-b0fe-b567145b4abf tempest-VolumesActionsTest-121883605 None] Lock "cinder-117adce3-717a-4664-8cfa-be7d1f5d0169-detach_volume" released by "detach_volume" :: held 0.100s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Acquiring lock "cinder-bc1f32c8-92eb-4399-a688-8f872006d7dd-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Lock "cinder-bc1f32c8-92eb-4399-a688-8f872006d7dd-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] remove_export for volume: bc1f32c8-92eb-4399-a688-8f872006d7dd. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-66974622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=bc1f32c8-92eb-4399-a688-8f872006d7dd,launched_at=2023-04-14T03:12:16Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0476d863fbd4b11b50eefa19a3a2067',provider_auth='CHAP zHItjhgM s31hKt0Akl4Bgn',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1f32c8-92eb-4399-a688-8f872006d7dd 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:12:15Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:12:17Z,updated_at=2023-04-14T03:12:17Z,use_quota=True,user_id='9a3fd915161942c1a40e10f8fe9e4899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:bc1f32c8-92eb-4399-a688-8f872006d7dd. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] detach volume v_bc1f32c8-92eb-4399-a688-8f872006d7dd from target iqn.2010-10.org.openstack:bc1f32c8-92eb-4399-a688-8f872006d7dd {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bc1f32c8-92eb-4399-a688-8f872006d7dd/luns/v_bc1f32c8-92eb-4399-a688-8f872006d7dd {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bc1f32c8-92eb-4399-a688-8f872006d7dd/luns/v_bc1f32c8-92eb-4399-a688-8f872006d7dd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bc1f32c8-92eb-4399-a688-8f872006d7dd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bc1f32c8-92eb-4399-a688-8f872006d7dd/luns/v_bc1f32c8-92eb-4399-a688-8f872006d7dd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bc1f32c8-92eb-4399-a688-8f872006d7dd/luns/v_bc1f32c8-92eb-4399-a688-8f872006d7dd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] failed to remove resource iqn.2010-10.org.openstack:bc1f32c8-92eb-4399-a688-8f872006d7dd because of JDSS resource v_bc1f32c8-92eb-4399-a688-8f872006d7dd DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] delete target: iqn.2010-10.org.openstack:bc1f32c8-92eb-4399-a688-8f872006d7dd {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] delete target iqn.2010-10.org.openstack:bc1f32c8-92eb-4399-a688-8f872006d7dd {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bc1f32c8-92eb-4399-a688-8f872006d7dd {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bc1f32c8-92eb-4399-a688-8f872006d7dd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bc1f32c8-92eb-4399-a688-8f872006d7dd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bc1f32c8-92eb-4399-a688-8f872006d7dd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bc1f32c8-92eb-4399-a688-8f872006d7dd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] failed to remove resource iqn.2010-10.org.openstack:bc1f32c8-92eb-4399-a688-8f872006d7dd because of JDSS resource iqn.2010-10.org.openstack:bc1f32c8-92eb-4399-a688-8f872006d7dd DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:12:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] deleating volume v_bc1f32c8-92eb-4399-a688-8f872006d7dd {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:12:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] get snapshots for volume v_bc1f32c8-92eb-4399-a688-8f872006d7dd {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:12:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bc1f32c8-92eb-4399-a688-8f872006d7dd/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bc1f32c8-92eb-4399-a688-8f872006d7dd/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bc1f32c8-92eb-4399-a688-8f872006d7dd/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] get volume v_bc1f32c8-92eb-4399-a688-8f872006d7dd info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:12:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bc1f32c8-92eb-4399-a688-8f872006d7dd {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bc1f32c8-92eb-4399-a688-8f872006d7dd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_bc1f32c8-92eb-4399-a688-8f872006d7dd', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443344', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113305', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4981559780352588938', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8b1615049da072da', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276306944', 'san:volume_id': '8b1615049da072daf439921239ba7f6344ca02dd', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85285', 'name': 'v_bc1f32c8-92eb-4399-a688-8f872006d7dd', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bc1f32c8-92eb-4399-a688-8f872006d7dd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] delete volume:v_bc1f32c8-92eb-4399-a688-8f872006d7dd recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:12:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bc1f32c8-92eb-4399-a688-8f872006d7dd {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bc1f32c8-92eb-4399-a688-8f872006d7dd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bc1f32c8-92eb-4399-a688-8f872006d7dd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] volume v_bc1f32c8-92eb-4399-a688-8f872006d7dd deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:12:19 user cinder-volume[73403]: DEBUG cinder.quota [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Created reservations ['970daf21-283c-4793-b975-f697d0293288', 'cb9e609e-8fd6-4792-ad3c-26eb260f9839', '77cd3eb6-a6a0-4270-83f6-9cddddf85393', 'a2e64381-6e15-4d3c-b7d7-a4d90d6c3383'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:12:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:12:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:12:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276388864', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:12:20 user cinder-volume[73403]: DEBUG cinder.manager [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:12:20 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Deleted volume successfully. Apr 14 03:12:20 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8cc232ee-8998-4640-8e5e-a8e86eabd28e tempest-VolumesTransfersTest-1836508910 None] Lock "cinder-bc1f32c8-92eb-4399-a688-8f872006d7dd-delete_volume" released by "delete_volume" :: held 3.122s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:12:23 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:12:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Flow 'volume_create_manager' (5bf00383-631f-40ee-9455-68d36a380d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:12:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a80b6c-29ff-4642-9905-6a4dd1831b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a80b6c-29ff-4642-9905-6a4dd1831b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1101204222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c983a366df184d96bbe3cd18382ea141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:12:24Z,use_quota=True,user_id='1ad729020d8d41dc9b89e556cb08ed9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5fd95f4-6c8c-4435-8a0a-a8f9ea9642f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5fd95f4-6c8c-4435-8a0a-a8f9ea9642f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696aaecd-567d-4446-96b8-33a4e2a6bf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696aaecd-567d-4446-96b8-33a4e2a6bf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59', 'volume_name': 'volume-53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3f2acd-3497-4ab6-84ad-939366a6ff20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3f2acd-3497-4ab6-84ad-939366a6ff20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:23 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9f7209-b083-43c8-ba69-cf495a8bc217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:23 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Volume 53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59', 'volume_size': 1} Apr 14 03:12:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] creating volume v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:12:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] create volume {'name': 'v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:12:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59', 'is_clone': False, 'name': 'v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9f7209-b083-43c8-ba69-cf495a8bc217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13233990-2649-4dc2-9374-862ebdfa69c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:24 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Volume volume-53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 (53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59): created successfully Apr 14 03:12:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13233990-2649-4dc2-9374-862ebdfa69c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Flow 'volume_create_manager' (5bf00383-631f-40ee-9455-68d36a380d33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:12:24 user cinder-volume[73403]: INFO cinder.volume.manager [None req-cf0fdea1-d31e-4e13-aba5-6cb828cb0e34 tempest-VolumesGetTest-230534178 None] Created volume successfully. Apr 14 03:12:26 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:12:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Flow 'volume_create_manager' (25099d89-9dc8-494b-996f-6504641bbbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:12:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd9f206-9c3e-4fe7-a063-3495f521bdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd9f206-9c3e-4fe7-a063-3495f521bdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-313528533',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=00c939a6-54a7-40b7-8ac9-58e11f00dc99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c983a366df184d96bbe3cd18382ea141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:12:27Z,use_quota=True,user_id='1ad729020d8d41dc9b89e556cb08ed9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b258b2-28d9-42cf-8a59-c18c42c93df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b258b2-28d9-42cf-8a59-c18c42c93df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770124fd-32d5-4c3c-942c-8be4e457d0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770124fd-32d5-4c3c-942c-8be4e457d0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00c939a6-54a7-40b7-8ac9-58e11f00dc99', 'volume_name': 'volume-00c939a6-54a7-40b7-8ac9-58e11f00dc99', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1470e11-d194-4551-858c-f8c7e31f2c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1470e11-d194-4551-858c-f8c7e31f2c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83bbadc-de16-45b4-abaf-5a16261e5940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:26 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Volume 00c939a6-54a7-40b7-8ac9-58e11f00dc99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00c939a6-54a7-40b7-8ac9-58e11f00dc99', 'volume_size': 1} Apr 14 03:12:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] creating volume v_00c939a6-54a7-40b7-8ac9-58e11f00dc99. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:12:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] create volume {'name': 'v_00c939a6-54a7-40b7-8ac9-58e11f00dc99', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:12:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_00c939a6-54a7-40b7-8ac9-58e11f00dc99', 'is_clone': False, 'name': 'v_00c939a6-54a7-40b7-8ac9-58e11f00dc99'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83bbadc-de16-45b4-abaf-5a16261e5940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c939a6-54a7-40b7-8ac9-58e11f00dc99', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919fc7d2-bf9d-4bbd-a975-c1cf9327fdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:27 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Volume volume-00c939a6-54a7-40b7-8ac9-58e11f00dc99 (00c939a6-54a7-40b7-8ac9-58e11f00dc99): created successfully Apr 14 03:12:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919fc7d2-bf9d-4bbd-a975-c1cf9327fdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Flow 'volume_create_manager' (25099d89-9dc8-494b-996f-6504641bbbcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:12:27 user cinder-volume[73403]: INFO cinder.volume.manager [None req-9c552973-fcce-4b5c-b5f8-c3d9f676ab13 tempest-VolumesGetTest-230534178 None] Created volume successfully. Apr 14 03:12:28 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Acquiring lock "cinder-00c939a6-54a7-40b7-8ac9-58e11f00dc99-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:12:28 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Lock "cinder-00c939a6-54a7-40b7-8ac9-58e11f00dc99-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:12:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] remove_export for volume: 00c939a6-54a7-40b7-8ac9-58e11f00dc99. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:12:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:12:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1101204222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=00c939a6-54a7-40b7-8ac9-58e11f00dc99,launched_at=2023-04-14T03:12:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c983a366df184d96bbe3cd18382ea141',provider_auth='CHAP NOpAGdSW 5yJmTWDXleRgjN',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c939a6-54a7-40b7-8ac9-58e11f00dc99 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:12:27Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:12:29Z,updated_at=2023-04-14T03:12:29Z,use_quota=True,user_id='1ad729020d8d41dc9b89e556cb08ed9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:00c939a6-54a7-40b7-8ac9-58e11f00dc99. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:12:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] detach volume v_00c939a6-54a7-40b7-8ac9-58e11f00dc99 from target iqn.2010-10.org.openstack:00c939a6-54a7-40b7-8ac9-58e11f00dc99 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:12:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00c939a6-54a7-40b7-8ac9-58e11f00dc99/luns/v_00c939a6-54a7-40b7-8ac9-58e11f00dc99 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00c939a6-54a7-40b7-8ac9-58e11f00dc99/luns/v_00c939a6-54a7-40b7-8ac9-58e11f00dc99 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:00c939a6-54a7-40b7-8ac9-58e11f00dc99 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00c939a6-54a7-40b7-8ac9-58e11f00dc99/luns/v_00c939a6-54a7-40b7-8ac9-58e11f00dc99'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00c939a6-54a7-40b7-8ac9-58e11f00dc99/luns/v_00c939a6-54a7-40b7-8ac9-58e11f00dc99 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] failed to remove resource iqn.2010-10.org.openstack:00c939a6-54a7-40b7-8ac9-58e11f00dc99 because of JDSS resource v_00c939a6-54a7-40b7-8ac9-58e11f00dc99 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:12:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] delete target: iqn.2010-10.org.openstack:00c939a6-54a7-40b7-8ac9-58e11f00dc99 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:12:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] delete target iqn.2010-10.org.openstack:00c939a6-54a7-40b7-8ac9-58e11f00dc99 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:12:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00c939a6-54a7-40b7-8ac9-58e11f00dc99 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00c939a6-54a7-40b7-8ac9-58e11f00dc99 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:00c939a6-54a7-40b7-8ac9-58e11f00dc99 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00c939a6-54a7-40b7-8ac9-58e11f00dc99'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00c939a6-54a7-40b7-8ac9-58e11f00dc99 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] failed to remove resource iqn.2010-10.org.openstack:00c939a6-54a7-40b7-8ac9-58e11f00dc99 because of JDSS resource iqn.2010-10.org.openstack:00c939a6-54a7-40b7-8ac9-58e11f00dc99 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:12:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] deleating volume v_00c939a6-54a7-40b7-8ac9-58e11f00dc99 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:12:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] get snapshots for volume v_00c939a6-54a7-40b7-8ac9-58e11f00dc99 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:12:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00c939a6-54a7-40b7-8ac9-58e11f00dc99/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00c939a6-54a7-40b7-8ac9-58e11f00dc99/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00c939a6-54a7-40b7-8ac9-58e11f00dc99/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] get volume v_00c939a6-54a7-40b7-8ac9-58e11f00dc99 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:12:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00c939a6-54a7-40b7-8ac9-58e11f00dc99 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00c939a6-54a7-40b7-8ac9-58e11f00dc99 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_00c939a6-54a7-40b7-8ac9-58e11f00dc99', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443356', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113315', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1126549262023525444', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ee2c0c57d81f021f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276200448', 'san:volume_id': 'ee2c0c57d81f021f0cab9765a857032896f3154a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84793', 'name': 'v_00c939a6-54a7-40b7-8ac9-58e11f00dc99', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00c939a6-54a7-40b7-8ac9-58e11f00dc99 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] delete volume:v_00c939a6-54a7-40b7-8ac9-58e11f00dc99 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:12:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00c939a6-54a7-40b7-8ac9-58e11f00dc99 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00c939a6-54a7-40b7-8ac9-58e11f00dc99 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00c939a6-54a7-40b7-8ac9-58e11f00dc99 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] volume v_00c939a6-54a7-40b7-8ac9-58e11f00dc99 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:12:31 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=65,cinder:INSERT=5,cinder:UPDATE=28,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:31 user cinder-volume[73403]: DEBUG cinder.quota [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Created reservations ['c349fd49-e601-4efa-b60d-650e7e4828af', '2f3460c4-08fa-4a89-b0a6-778921ae8371', 'dab587ff-be8e-44f1-a5b2-e9950bce721d', 'b82d6c14-5b20-4547-90c7-b60a5cb0978b'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:12:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:12:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:12:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Acquiring lock "cinder-53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Lock "cinder-53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] remove_export for volume: 53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:24Z,deleted=False,deleted_at=None,display_description='This is the new description of volume',display_name='tempest-VolumesGetTest-new-Volume-373489328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59,launched_at=2023-04-14T03:12:25Z,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c983a366df184d96bbe3cd18382ea141',provider_auth='CHAP QLHFlhSJ N3erdHTsO7I58K',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:12:24Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:12:32Z,updated_at=2023-04-14T03:12:32Z,use_quota=True,user_id='1ad729020d8d41dc9b89e556cb08ed9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] detach volume v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 from target iqn.2010-10.org.openstack:53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59/luns/v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59/luns/v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276282368', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.manager [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:12:32 user cinder-volume[73403]: INFO cinder.volume.manager [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Deleted volume successfully. Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b976e529-05fb-4d68-991d-47e02bbad89e tempest-VolumesGetTest-230534178 None] Lock "cinder-00c939a6-54a7-40b7-8ac9-58e11f00dc99-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59/luns/v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59/luns/v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] failed to remove resource iqn.2010-10.org.openstack:53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 because of JDSS resource v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] delete target: iqn.2010-10.org.openstack:53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] delete target iqn.2010-10.org.openstack:53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] failed to remove resource iqn.2010-10.org.openstack:53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 because of JDSS resource iqn.2010-10.org.openstack:53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] deleating volume v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] get snapshots for volume v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] get volume v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443353', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113311', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8091987781420886866', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c48ef144341b25ec', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276282368', 'san:volume_id': 'c48ef144341b25ec86a2ebc3968aef24ddaefae0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85220', 'name': 'v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] delete volume:v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] volume v_53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:12:34 user cinder-volume[73403]: DEBUG cinder.quota [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Created reservations ['0267b65f-a1ba-43bc-be51-0d64fb03dbec', '5a0a0d7d-c854-4c3b-acce-93c90fad74cd', '339d8602-8ff5-41cd-89b8-1355b5751c3f', '0682ff99-ec41-4214-84ed-3d45ba7d36c7'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:12:34 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=59,cinder:UPDATE=29,cinder:INSERT=9,cinder:DELETE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:12:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:12:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276364288', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:12:35 user cinder-volume[73403]: DEBUG cinder.manager [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:12:35 user cinder-volume[73403]: INFO cinder.volume.manager [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Deleted volume successfully. Apr 14 03:12:35 user cinder-volume[73403]: DEBUG cinder.coordination [None req-c27c45e2-6e44-4743-a0a7-e0769b3429cf tempest-VolumesGetTest-230534178 None] Lock "cinder-53ad9cb8-258a-4cdb-b4a1-b9e3d59bed59-delete_volume" released by "delete_volume" :: held 3.432s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:12:35 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:12:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Flow 'volume_create_manager' (bc2d9f02-95ba-459f-8dc2-c40a3d34faa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:12:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5de799-c7f3-4185-a8ac-58ed5b50081d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5de799-c7f3-4185-a8ac-58ed5b50081d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-239133204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8d54101e-a0e0-41c9-ba91-c2956895b115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c983a366df184d96bbe3cd18382ea141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:12:36Z,use_quota=True,user_id='1ad729020d8d41dc9b89e556cb08ed9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (916379b4-383a-46ce-a0c8-16eb6a21ef8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (916379b4-383a-46ce-a0c8-16eb6a21ef8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd585523-a1c5-47b8-80a1-50286782f932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd585523-a1c5-47b8-80a1-50286782f932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d54101e-a0e0-41c9-ba91-c2956895b115', 'volume_name': 'volume-8d54101e-a0e0-41c9-ba91-c2956895b115', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e401bf-18bd-43dd-9fcb-526370a556a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e401bf-18bd-43dd-9fcb-526370a556a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c5589d-3fc8-42ee-8c68-a953f06d6f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:35 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Volume 8d54101e-a0e0-41c9-ba91-c2956895b115: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d54101e-a0e0-41c9-ba91-c2956895b115', 'volume_size': 1} Apr 14 03:12:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] creating volume v_8d54101e-a0e0-41c9-ba91-c2956895b115. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:12:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] create volume {'name': 'v_8d54101e-a0e0-41c9-ba91-c2956895b115', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:12:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_8d54101e-a0e0-41c9-ba91-c2956895b115', 'is_clone': False, 'name': 'v_8d54101e-a0e0-41c9-ba91-c2956895b115'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c5589d-3fc8-42ee-8c68-a953f06d6f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d54101e-a0e0-41c9-ba91-c2956895b115', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564bd5b2-c32b-4a49-b929-8a3202be90dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:36 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Volume volume-8d54101e-a0e0-41c9-ba91-c2956895b115 (8d54101e-a0e0-41c9-ba91-c2956895b115): created successfully Apr 14 03:12:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564bd5b2-c32b-4a49-b929-8a3202be90dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Flow 'volume_create_manager' (bc2d9f02-95ba-459f-8dc2-c40a3d34faa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:12:36 user cinder-volume[73403]: INFO cinder.volume.manager [None req-1d938994-3ae3-405f-995c-9a98bf72a212 tempest-VolumesGetTest-230534178 None] Created volume successfully. Apr 14 03:12:37 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:12:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Flow 'volume_create_manager' (dbe77049-866f-416b-b64e-d96796873cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:12:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1bfa042-6298-44cd-8c60-2cc706fd5088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1bfa042-6298-44cd-8c60-2cc706fd5088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1992897063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=65565e1f-b303-4fec-8b41-f66ac1701ad9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c983a366df184d96bbe3cd18382ea141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=8d54101e-a0e0-41c9-ba91-c2956895b115,status='creating',terminated_at=None,updated_at=2023-04-14T03:12:37Z,use_quota=True,user_id='1ad729020d8d41dc9b89e556cb08ed9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec483f86-7987-4e13-a80f-b8952786bd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec483f86-7987-4e13-a80f-b8952786bd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aea3045-d817-4e84-929b-153f9cfbc6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aea3045-d817-4e84-929b-153f9cfbc6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '65565e1f-b303-4fec-8b41-f66ac1701ad9', 'volume_name': 'volume-65565e1f-b303-4fec-8b41-f66ac1701ad9', 'volume_size': 1, 'source_volid': '8d54101e-a0e0-41c9-ba91-c2956895b115', 'source_volstatus': 'available'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba4a991-675f-4196-92df-8cfe05efd060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba4a991-675f-4196-92df-8cfe05efd060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fec531d-c8ea-41b6-a6dd-8a10534d0d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:37 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Volume 65565e1f-b303-4fec-8b41-f66ac1701ad9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-65565e1f-b303-4fec-8b41-f66ac1701ad9', 'volume_size': 1, 'source_volid': '8d54101e-a0e0-41c9-ba91-c2956895b115', 'source_volstatus': 'available'} Apr 14 03:12:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] cloned volume 8d54101e-a0e0-41c9-ba91-c2956895b115 to 65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 03:12:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] cloning v_8d54101e-a0e0-41c9-ba91-c2956895b115 to v_65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:12:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] create snapshot v_65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:12:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d54101e-a0e0-41c9-ba91-c2956895b115/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d54101e-a0e0-41c9-ba91-c2956895b115/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_65565e1f-b303-4fec-8b41-f66ac1701ad9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d54101e-a0e0-41c9-ba91-c2956895b115/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] create volume v_65565e1f-b303-4fec-8b41-f66ac1701ad9 from snapshot v_65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:12:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d54101e-a0e0-41c9-ba91-c2956895b115/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d54101e-a0e0-41c9-ba91-c2956895b115/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8d54101e-a0e0-41c9-ba91-c2956895b115@v_65565e1f-b303-4fec-8b41-f66ac1701ad9', 'is_clone': True, 'full_name': 'Pool-0/v_65565e1f-b303-4fec-8b41-f66ac1701ad9', 'name': 'v_65565e1f-b303-4fec-8b41-f66ac1701ad9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d54101e-a0e0-41c9-ba91-c2956895b115/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] get volume v_65565e1f-b303-4fec-8b41-f66ac1701ad9 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:12:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8d54101e-a0e0-41c9-ba91-c2956895b115@v_65565e1f-b303-4fec-8b41-f66ac1701ad9', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_65565e1f-b303-4fec-8b41-f66ac1701ad9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443367', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113327', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12078115863514985320', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '613ad76efc174de6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276270080', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84065', 'name': 'v_65565e1f-b303-4fec-8b41-f66ac1701ad9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fec531d-c8ea-41b6-a6dd-8a10534d0d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65565e1f-b303-4fec-8b41-f66ac1701ad9', 'volume_size': 1, 'source_volid': '8d54101e-a0e0-41c9-ba91-c2956895b115', 'source_volstatus': 'available'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aec624a-7158-4ca6-a922-26e700be79bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:39 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Volume volume-65565e1f-b303-4fec-8b41-f66ac1701ad9 (65565e1f-b303-4fec-8b41-f66ac1701ad9): created successfully Apr 14 03:12:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aec624a-7158-4ca6-a922-26e700be79bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Flow 'volume_create_manager' (dbe77049-866f-416b-b64e-d96796873cf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:12:39 user cinder-volume[73403]: INFO cinder.volume.manager [None req-78ec7491-3bf0-49e8-9baa-f7ce1dde059e tempest-VolumesGetTest-230534178 None] Created volume successfully. Apr 14 03:12:40 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:12:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Flow 'volume_create_manager' (75e0909b-3350-40fd-a9b1-ed9dd3996ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:12:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f789f546-ea34-4720-a18d-72a107e7bcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f789f546-ea34-4720-a18d-72a107e7bcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1021557497',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ea63c4ac-bc9f-41af-b3ef-94e7f7147baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c983a366df184d96bbe3cd18382ea141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:12:41Z,use_quota=True,user_id='1ad729020d8d41dc9b89e556cb08ed9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9765ce40-acae-4e71-9b42-882136fdeddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9765ce40-acae-4e71-9b42-882136fdeddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7cd0dbb-8064-4a91-902c-74e2afd5d712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7cd0dbb-8064-4a91-902c-74e2afd5d712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea63c4ac-bc9f-41af-b3ef-94e7f7147baf', 'volume_name': 'volume-ea63c4ac-bc9f-41af-b3ef-94e7f7147baf', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae390257-e56e-4f4e-9f35-58fde667b7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae390257-e56e-4f4e-9f35-58fde667b7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af35b90e-403a-4c21-8b9a-54cf0e9d8e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:40 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Volume ea63c4ac-bc9f-41af-b3ef-94e7f7147baf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea63c4ac-bc9f-41af-b3ef-94e7f7147baf', 'volume_size': 1} Apr 14 03:12:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] creating volume v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:12:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] create volume {'name': 'v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:12:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf', 'is_clone': False, 'name': 'v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:41 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af35b90e-403a-4c21-8b9a-54cf0e9d8e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea63c4ac-bc9f-41af-b3ef-94e7f7147baf', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:41 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b621ee-156c-440c-b112-89f8ef955aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:41 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Volume volume-ea63c4ac-bc9f-41af-b3ef-94e7f7147baf (ea63c4ac-bc9f-41af-b3ef-94e7f7147baf): created successfully Apr 14 03:12:41 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b621ee-156c-440c-b112-89f8ef955aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:41 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Flow 'volume_create_manager' (75e0909b-3350-40fd-a9b1-ed9dd3996ad4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:12:41 user cinder-volume[73403]: INFO cinder.volume.manager [None req-2e5484df-6f24-41c6-9512-8229b30bfc4c tempest-VolumesGetTest-230534178 None] Created volume successfully. Apr 14 03:12:42 user cinder-volume[73403]: DEBUG cinder.coordination [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Acquiring lock "cinder-ea63c4ac-bc9f-41af-b3ef-94e7f7147baf-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:12:42 user cinder-volume[73403]: DEBUG cinder.coordination [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Lock "cinder-ea63c4ac-bc9f-41af-b3ef-94e7f7147baf-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:12:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] remove_export for volume: ea63c4ac-bc9f-41af-b3ef-94e7f7147baf. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:12:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:12:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1992897063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ea63c4ac-bc9f-41af-b3ef-94e7f7147baf,launched_at=2023-04-14T03:12:42Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c983a366df184d96bbe3cd18382ea141',provider_auth='CHAP cZfnsNUr bRHz1QshUlW9oA',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea63c4ac-bc9f-41af-b3ef-94e7f7147baf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:12:41Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:12:43Z,updated_at=2023-04-14T03:12:43Z,use_quota=True,user_id='1ad729020d8d41dc9b89e556cb08ed9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:ea63c4ac-bc9f-41af-b3ef-94e7f7147baf. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:12:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] detach volume v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf from target iqn.2010-10.org.openstack:ea63c4ac-bc9f-41af-b3ef-94e7f7147baf {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:12:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ea63c4ac-bc9f-41af-b3ef-94e7f7147baf/luns/v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ea63c4ac-bc9f-41af-b3ef-94e7f7147baf/luns/v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ea63c4ac-bc9f-41af-b3ef-94e7f7147baf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ea63c4ac-bc9f-41af-b3ef-94e7f7147baf/luns/v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ea63c4ac-bc9f-41af-b3ef-94e7f7147baf/luns/v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] failed to remove resource iqn.2010-10.org.openstack:ea63c4ac-bc9f-41af-b3ef-94e7f7147baf because of JDSS resource v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:12:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] delete target: iqn.2010-10.org.openstack:ea63c4ac-bc9f-41af-b3ef-94e7f7147baf {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:12:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] delete target iqn.2010-10.org.openstack:ea63c4ac-bc9f-41af-b3ef-94e7f7147baf {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:12:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ea63c4ac-bc9f-41af-b3ef-94e7f7147baf {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ea63c4ac-bc9f-41af-b3ef-94e7f7147baf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ea63c4ac-bc9f-41af-b3ef-94e7f7147baf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ea63c4ac-bc9f-41af-b3ef-94e7f7147baf'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ea63c4ac-bc9f-41af-b3ef-94e7f7147baf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] failed to remove resource iqn.2010-10.org.openstack:ea63c4ac-bc9f-41af-b3ef-94e7f7147baf because of JDSS resource iqn.2010-10.org.openstack:ea63c4ac-bc9f-41af-b3ef-94e7f7147baf DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:12:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] deleating volume v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:12:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] get snapshots for volume v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:12:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] get volume v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:12:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443370', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113331', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15525498673273474631', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '53e29f2ef11f9197', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276175872', 'san:volume_id': '53e29f2ef11f9197d7d7b3c3ca0b13a42c1145b8', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84077', 'name': 'v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] delete volume:v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:12:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-57f14ac6-89c4-4875-8457-33c058037c39 tempest-TestVolumeBootPattern-910285030 None] create snapshot ed48619f-2a10-4992-8c6d-6520e0d6f7ba for volume c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:12:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-57f14ac6-89c4-4875-8457-33c058037c39 tempest-TestVolumeBootPattern-910285030 None] cloning v_c6fbfee2-70fa-477a-a761-8d092061e691 to s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:12:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-57f14ac6-89c4-4875-8457-33c058037c39 tempest-TestVolumeBootPattern-910285030 None] create snapshot s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:12:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57f14ac6-89c4-4875-8457-33c058037c39 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6fbfee2-70fa-477a-a761-8d092061e691/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57f14ac6-89c4-4875-8457-33c058037c39 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6fbfee2-70fa-477a-a761-8d092061e691/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57f14ac6-89c4-4875-8457-33c058037c39 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_ed48619f-2a10-4992-8c6d-6520e0d6f7ba'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6fbfee2-70fa-477a-a761-8d092061e691/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-57f14ac6-89c4-4875-8457-33c058037c39 tempest-TestVolumeBootPattern-910285030 None] create volume s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba from snapshot s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:12:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57f14ac6-89c4-4875-8457-33c058037c39 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6fbfee2-70fa-477a-a761-8d092061e691/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57f14ac6-89c4-4875-8457-33c058037c39 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6fbfee2-70fa-477a-a761-8d092061e691/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57f14ac6-89c4-4875-8457-33c058037c39 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c6fbfee2-70fa-477a-a761-8d092061e691@s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba', 'is_clone': True, 'full_name': 'Pool-0/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba', 'name': 's_ed48619f-2a10-4992-8c6d-6520e0d6f7ba'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6fbfee2-70fa-477a-a761-8d092061e691/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57f14ac6-89c4-4875-8457-33c058037c39 tempest-TestVolumeBootPattern-910285030 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57f14ac6-89c4-4875-8457-33c058037c39 tempest-TestVolumeBootPattern-910285030 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57f14ac6-89c4-4875-8457-33c058037c39 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-57f14ac6-89c4-4875-8457-33c058037c39 tempest-TestVolumeBootPattern-910285030 None] volume s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:12:46 user cinder-volume[73403]: INFO cinder.volume.manager [None req-57f14ac6-89c4-4875-8457-33c058037c39 tempest-TestVolumeBootPattern-910285030 None] Create snapshot completed successfully Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] volume v_ea63c4ac-bc9f-41af-b3ef-94e7f7147baf deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.quota [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Created reservations ['592fe6ec-0eaa-41f9-b8da-5538beea8eff', 'eca2ca13-cd8a-4b05-a76c-e87442996fe9', '037573a2-85fc-4cbe-8ee5-d84566eb1b25', '9786c313-a10c-4b8c-9e12-2b5fefe5e013'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Flow 'volume_create_manager' (222a3946-94cf-4151-bb34-fcbdbc1bcde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be62ab48-3bd3-4005-a5e4-c91be1f94c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be62ab48-3bd3-4005-a5e4-c91be1f94c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-1785204424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0ae128f0-64ab-4413-bae2-15cd90212c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2e49e8e92e416faebf55e3d4e0e087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ed48619f-2a10-4992-8c6d-6520e0d6f7ba,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:12:48Z,use_quota=True,user_id='60e11b7ab2914209b23bf7a53791da64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d3fcbe-9369-4853-9516-3151f971cdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d3fcbe-9369-4853-9516-3151f971cdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759c9ef6-9db0-47b7-84be-4eb5ab00fac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759c9ef6-9db0-47b7-84be-4eb5ab00fac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0ae128f0-64ab-4413-bae2-15cd90212c53', 'volume_name': 'volume-0ae128f0-64ab-4413-bae2-15cd90212c53', 'volume_size': 1, 'snapshot_id': 'ed48619f-2a10-4992-8c6d-6520e0d6f7ba'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411c77a2-0d9a-4cd5-aa58-8db0cb1a02e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411c77a2-0d9a-4cd5-aa58-8db0cb1a02e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2207bee0-7d94-4294-aa7a-4c7d040d1739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:47 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Volume 0ae128f0-64ab-4413-bae2-15cd90212c53: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0ae128f0-64ab-4413-bae2-15cd90212c53', 'volume_size': 1, 'snapshot_id': 'ed48619f-2a10-4992-8c6d-6520e0d6f7ba'} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] create volume 0ae128f0-64ab-4413-bae2-15cd90212c53 from snapshot ed48619f-2a10-4992-8c6d-6520e0d6f7ba {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] cloning s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba to v_0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] create snapshot v_0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276200448', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.manager [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:12:48 user cinder-volume[73403]: INFO cinder.volume.manager [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Deleted volume successfully. Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.coordination [None req-fcba0e4a-6bbd-423a-9d2f-4862f2a96fd5 tempest-VolumesGetTest-230534178 None] Lock "cinder-ea63c4ac-bc9f-41af-b3ef-94e7f7147baf-delete_volume" released by "delete_volume" :: held 5.084s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Acquiring lock "cinder-65565e1f-b303-4fec-8b41-f66ac1701ad9-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Lock "cinder-65565e1f-b303-4fec-8b41-f66ac1701ad9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] remove_export for volume: 65565e1f-b303-4fec-8b41-f66ac1701ad9. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:37Z,deleted=False,deleted_at=None,display_description='This is the new description of volume',display_name='tempest-VolumesGetTest-new-Volume-245425243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=65565e1f-b303-4fec-8b41-f66ac1701ad9,launched_at=2023-04-14T03:12:39Z,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c983a366df184d96bbe3cd18382ea141',provider_auth='CHAP WaUVHCYN TAKaDSQ5wf7tip',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:65565e1f-b303-4fec-8b41-f66ac1701ad9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:12:37Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=8d54101e-a0e0-41c9-ba91-c2956895b115,status='deleting',terminated_at=2023-04-14T03:12:48Z,updated_at=2023-04-14T03:12:48Z,use_quota=True,user_id='1ad729020d8d41dc9b89e556cb08ed9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:65565e1f-b303-4fec-8b41-f66ac1701ad9. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] detach volume v_65565e1f-b303-4fec-8b41-f66ac1701ad9 from target iqn.2010-10.org.openstack:65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:65565e1f-b303-4fec-8b41-f66ac1701ad9/luns/v_65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:65565e1f-b303-4fec-8b41-f66ac1701ad9/luns/v_65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:65565e1f-b303-4fec-8b41-f66ac1701ad9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:65565e1f-b303-4fec-8b41-f66ac1701ad9/luns/v_65565e1f-b303-4fec-8b41-f66ac1701ad9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:65565e1f-b303-4fec-8b41-f66ac1701ad9/luns/v_65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] failed to remove resource iqn.2010-10.org.openstack:65565e1f-b303-4fec-8b41-f66ac1701ad9 because of JDSS resource v_65565e1f-b303-4fec-8b41-f66ac1701ad9 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] delete target: iqn.2010-10.org.openstack:65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] delete target iqn.2010-10.org.openstack:65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:65565e1f-b303-4fec-8b41-f66ac1701ad9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:65565e1f-b303-4fec-8b41-f66ac1701ad9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] failed to remove resource iqn.2010-10.org.openstack:65565e1f-b303-4fec-8b41-f66ac1701ad9 because of JDSS resource iqn.2010-10.org.openstack:65565e1f-b303-4fec-8b41-f66ac1701ad9 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] deleating volume v_65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] get snapshots for volume v_65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65565e1f-b303-4fec-8b41-f66ac1701ad9/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65565e1f-b303-4fec-8b41-f66ac1701ad9/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65565e1f-b303-4fec-8b41-f66ac1701ad9/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] get volume v_65565e1f-b303-4fec-8b41-f66ac1701ad9 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_0ae128f0-64ab-4413-bae2-15cd90212c53'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] create volume v_0ae128f0-64ab-4413-bae2-15cd90212c53 from snapshot v_0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8d54101e-a0e0-41c9-ba91-c2956895b115@v_65565e1f-b303-4fec-8b41-f66ac1701ad9', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_65565e1f-b303-4fec-8b41-f66ac1701ad9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443367', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113327', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12078115863514985320', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '613ad76efc174de6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276175872', 'san:volume_id': '613ad76efc174de60a0c04a9ef14798d9b7741a7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84065', 'name': 'v_65565e1f-b303-4fec-8b41-f66ac1701ad9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] delete snapshot v_65565e1f-b303-4fec-8b41-f66ac1701ad9 of volume v_8d54101e-a0e0-41c9-ba91-c2956895b115 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d54101e-a0e0-41c9-ba91-c2956895b115/snapshots/v_65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d54101e-a0e0-41c9-ba91-c2956895b115/snapshots/v_65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba@v_0ae128f0-64ab-4413-bae2-15cd90212c53', 'is_clone': True, 'full_name': 'Pool-0/v_0ae128f0-64ab-4413-bae2-15cd90212c53', 'name': 'v_0ae128f0-64ab-4413-bae2-15cd90212c53'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] get volume v_0ae128f0-64ab-4413-bae2-15cd90212c53 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:12:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba@v_0ae128f0-64ab-4413-bae2-15cd90212c53', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_0ae128f0-64ab-4413-bae2-15cd90212c53', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443378', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26116096', 'sharesmb': None, 'createtxg': '113344', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5128266426500650152', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4ecc76451de02704', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276163584', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84805', 'name': 'v_0ae128f0-64ab-4413-bae2-15cd90212c53', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:50 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Marking volume 0ae128f0-64ab-4413-bae2-15cd90212c53 as bootable. {{(pid=73403) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 03:12:50 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Copying metadata from snapshot ed48619f-2a10-4992-8c6d-6520e0d6f7ba to 0ae128f0-64ab-4413-bae2-15cd90212c53. {{(pid=73403) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Apr 14 03:12:50 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=37,cinder:SELECT=57,cinder:INSERT=4,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:50 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=16,cinder:SELECT=58,cinder:DELETE=4,cinder:INSERT=22 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:12:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2207bee0-7d94-4294-aa7a-4c7d040d1739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ae128f0-64ab-4413-bae2-15cd90212c53', 'volume_size': 1, 'snapshot_id': 'ed48619f-2a10-4992-8c6d-6520e0d6f7ba'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8afcca1-62f6-4018-a43b-27e8323dba07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:50 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Volume volume-0ae128f0-64ab-4413-bae2-15cd90212c53 (0ae128f0-64ab-4413-bae2-15cd90212c53): created successfully Apr 14 03:12:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8afcca1-62f6-4018-a43b-27e8323dba07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Flow 'volume_create_manager' (222a3946-94cf-4151-bb34-fcbdbc1bcde3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:12:50 user cinder-volume[73403]: INFO cinder.volume.manager [None req-f46bbe81-0cbd-41f3-be15-711db1502155 tempest-TestVolumeBootPattern-910285030 None] Created volume successfully. Apr 14 03:12:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d54101e-a0e0-41c9-ba91-c2956895b115/snapshots/v_65565e1f-b303-4fec-8b41-f66ac1701ad9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] snapshot v_65565e1f-b303-4fec-8b41-f66ac1701ad9 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:12:50 user cinder-volume[73403]: DEBUG cinder.quota [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Created reservations ['d80407da-1ba4-43aa-89b7-76b505cd5070', 'cf6e0745-452e-4fdf-9188-0f4e389a7105', '4a2a168a-47f0-4921-a1d6-6a7c33e6d842', '5f19aefb-7b6a-4624-98d9-075b29cc6f2e'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:12:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:12:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:12:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276057088', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.manager [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:12:51 user cinder-volume[73403]: INFO cinder.volume.manager [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Deleted volume successfully. Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f17d6ca8-2b23-42b3-b9fb-24898dd52b00 tempest-VolumesGetTest-230534178 None] Lock "cinder-65565e1f-b303-4fec-8b41-f66ac1701ad9-delete_volume" released by "delete_volume" :: held 3.194s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.coordination [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Acquiring lock "cinder-8d54101e-a0e0-41c9-ba91-c2956895b115-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.coordination [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Lock "cinder-8d54101e-a0e0-41c9-ba91-c2956895b115-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] remove_export for volume: 8d54101e-a0e0-41c9-ba91-c2956895b115. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-239133204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8d54101e-a0e0-41c9-ba91-c2956895b115,launched_at=2023-04-14T03:12:37Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c983a366df184d96bbe3cd18382ea141',provider_auth='CHAP NtcJXGgy 1GX9ml0dfDRhEw',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d54101e-a0e0-41c9-ba91-c2956895b115 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:12:36Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:12:52Z,updated_at=2023-04-14T03:12:52Z,use_quota=True,user_id='1ad729020d8d41dc9b89e556cb08ed9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:8d54101e-a0e0-41c9-ba91-c2956895b115. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] detach volume v_8d54101e-a0e0-41c9-ba91-c2956895b115 from target iqn.2010-10.org.openstack:8d54101e-a0e0-41c9-ba91-c2956895b115 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8d54101e-a0e0-41c9-ba91-c2956895b115/luns/v_8d54101e-a0e0-41c9-ba91-c2956895b115 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8d54101e-a0e0-41c9-ba91-c2956895b115/luns/v_8d54101e-a0e0-41c9-ba91-c2956895b115 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8d54101e-a0e0-41c9-ba91-c2956895b115 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8d54101e-a0e0-41c9-ba91-c2956895b115/luns/v_8d54101e-a0e0-41c9-ba91-c2956895b115'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8d54101e-a0e0-41c9-ba91-c2956895b115/luns/v_8d54101e-a0e0-41c9-ba91-c2956895b115 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] failed to remove resource iqn.2010-10.org.openstack:8d54101e-a0e0-41c9-ba91-c2956895b115 because of JDSS resource v_8d54101e-a0e0-41c9-ba91-c2956895b115 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] delete target: iqn.2010-10.org.openstack:8d54101e-a0e0-41c9-ba91-c2956895b115 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] delete target iqn.2010-10.org.openstack:8d54101e-a0e0-41c9-ba91-c2956895b115 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8d54101e-a0e0-41c9-ba91-c2956895b115 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8d54101e-a0e0-41c9-ba91-c2956895b115 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8d54101e-a0e0-41c9-ba91-c2956895b115 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8d54101e-a0e0-41c9-ba91-c2956895b115'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8d54101e-a0e0-41c9-ba91-c2956895b115 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] failed to remove resource iqn.2010-10.org.openstack:8d54101e-a0e0-41c9-ba91-c2956895b115 because of JDSS resource iqn.2010-10.org.openstack:8d54101e-a0e0-41c9-ba91-c2956895b115 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] deleating volume v_8d54101e-a0e0-41c9-ba91-c2956895b115 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] get snapshots for volume v_8d54101e-a0e0-41c9-ba91-c2956895b115 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d54101e-a0e0-41c9-ba91-c2956895b115/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d54101e-a0e0-41c9-ba91-c2956895b115/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d54101e-a0e0-41c9-ba91-c2956895b115/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] get volume v_8d54101e-a0e0-41c9-ba91-c2956895b115 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:12:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d54101e-a0e0-41c9-ba91-c2956895b115 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d54101e-a0e0-41c9-ba91-c2956895b115 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8d54101e-a0e0-41c9-ba91-c2956895b115', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443365', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113321', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4486072100464478365', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '334c6147008fa958', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276057088', 'san:volume_id': '334c6147008fa9585328752fd711b2efa453e1da', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85229', 'name': 'v_8d54101e-a0e0-41c9-ba91-c2956895b115', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d54101e-a0e0-41c9-ba91-c2956895b115 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] delete volume:v_8d54101e-a0e0-41c9-ba91-c2956895b115 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:12:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d54101e-a0e0-41c9-ba91-c2956895b115 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d54101e-a0e0-41c9-ba91-c2956895b115 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] create export for volume: 0ae128f0-64ab-4413-bae2-15cd90212c53. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:12:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] ensure volume 0ae128f0-64ab-4413-bae2-15cd90212c53 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:12:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] check if targe iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:12:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] create target and attach volume 0ae128f0-64ab-4413-bae2-15cd90212c53 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:12:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] create target iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:12:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d54101e-a0e0-41c9-ba91-c2956895b115 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] volume v_8d54101e-a0e0-41c9-ba91-c2956895b115 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:12:54 user cinder-volume[73403]: DEBUG cinder.quota [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Created reservations ['1b7e7237-32fc-4ac2-9fff-449c01f0ae7d', '5ab8280d-131e-4023-8c33-13f16c917c5e', '7bdb6817-a610-4f52-81aa-a1bfba102ae6', '43c7a218-e604-4558-8376-8dd47ced02bf'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:12:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:12:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:12:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276139008', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:12:54 user cinder-volume[73403]: DEBUG cinder.manager [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:12:54 user cinder-volume[73403]: INFO cinder.volume.manager [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Deleted volume successfully. Apr 14 03:12:54 user cinder-volume[73403]: DEBUG cinder.coordination [None req-3b2ff89c-eb33-4f2b-98a6-3ebd874b38e9 tempest-VolumesGetTest-230534178 None] Lock "cinder-8d54101e-a0e0-41c9-ba91-c2956895b115-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Flow 'volume_create_manager' (074481c4-ed7b-4d21-958a-cde94e805eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d171ed8a-a12f-4fbb-9602-fd0603d5e0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d171ed8a-a12f-4fbb-9602-fd0603d5e0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1745670955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9fa66191-eab2-427b-9270-9a000e40caa1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c983a366df184d96bbe3cd18382ea141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:12:55Z,use_quota=True,user_id='1ad729020d8d41dc9b89e556cb08ed9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca8b1953-b9ac-4f98-a291-0ef627f574fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca8b1953-b9ac-4f98-a291-0ef627f574fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d692d9d0-78f0-4547-83c2-d6c88d816068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d692d9d0-78f0-4547-83c2-d6c88d816068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9fa66191-eab2-427b-9270-9a000e40caa1', 'volume_name': 'volume-9fa66191-eab2-427b-9270-9a000e40caa1', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2a5e16-b9a2-4e30-9991-8c6737cb66fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2a5e16-b9a2-4e30-9991-8c6737cb66fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba27671-4087-4457-89f7-9739c32e1fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:55 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Volume 9fa66191-eab2-427b-9270-9a000e40caa1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9fa66191-eab2-427b-9270-9a000e40caa1', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Cloning 9fa66191-eab2-427b-9270-9a000e40caa1 from image 98e6a247-250b-4bb5-a947-e7f93598d16e at location (None, None). {{(pid=73403) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Acquiring lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" by "_prepare_image_cache_entry" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 3, 12, 55, 517930)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Found cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Attempting to retrieve cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 3, 12, 55, 532134)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Creating from source image-volume 482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] cloned volume 482f938f-083c-4221-99f8-3320a80b8725 to 9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] cloning v_482f938f-083c-4221-99f8-3320a80b8725 to v_9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] create snapshot v_9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] atach volume v_0ae128f0-64ab-4413-bae2-15cd90212c53 to target iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:12:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_9fa66191-eab2-427b-9270-9a000e40caa1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] create volume v_9fa66191-eab2-427b-9270-9a000e40caa1 from snapshot v_9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:12:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_9fa66191-eab2-427b-9270-9a000e40caa1', 'is_clone': True, 'full_name': 'Pool-0/v_9fa66191-eab2-427b-9270-9a000e40caa1', 'name': 'v_9fa66191-eab2-427b-9270-9a000e40caa1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] get volume v_9fa66191-eab2-427b-9270-9a000e40caa1 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:12:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_9fa66191-eab2-427b-9270-9a000e40caa1', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9fa66191-eab2-427b-9270-9a000e40caa1', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443385', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '113353', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16306877213952085397', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7ff4defb0cb46a69', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276102144', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85240', 'name': 'v_9fa66191-eab2-427b-9270-9a000e40caa1', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:57 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Marking volume 9fa66191-eab2-427b-9270-9a000e40caa1 as bootable. {{(pid=73403) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 03:12:57 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Copying metadata from image 98e6a247-250b-4bb5-a947-e7f93598d16e to 9fa66191-eab2-427b-9270-9a000e40caa1. {{(pid=73403) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 03:12:57 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Creating volume glance metadata for volume 9fa66191-eab2-427b-9270-9a000e40caa1 backed by image 98e6a247-250b-4bb5-a947-e7f93598d16e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73403) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 03:12:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba27671-4087-4457-89f7-9739c32e1fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fa66191-eab2-427b-9270-9a000e40caa1', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce17000-7e15-4eb1-ad6d-5afd17a85abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:57 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Volume volume-9fa66191-eab2-427b-9270-9a000e40caa1 (9fa66191-eab2-427b-9270-9a000e40caa1): created successfully Apr 14 03:12:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce17000-7e15-4eb1-ad6d-5afd17a85abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Flow 'volume_create_manager' (074481c4-ed7b-4d21-958a-cde94e805eb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:12:57 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8a68473a-f7d4-4a84-96bd-5aa6e6585ea3 tempest-VolumesGetTest-230534178 None] Created volume successfully. Apr 14 03:12:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3465636337363435', 'lun': 0, 'mode': 'wt', 'name': 'v_0ae128f0-64ab-4413-bae2-15cd90212c53', 'prod_id': 'Storage', 'scsi_id': '4ecc76451de02704'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] add credentails to target iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:12:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:12:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 201, 'error': None, 'data': {'name': 'tyovbWPn'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:12:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] initialize_connection for 0ae128f0-64ab-4413-bae2-15cd90212c53 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:12:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyovbWPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'b02ad57f-7445-460d-9b5a-d11efdcd54d4'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:12:57 user cinder-volume[73403]: INFO cinder.volume.manager [req-425dbef7-e950-41a7-98ea-4facba282d02 req-b2267eea-eba0-44a4-9d02-ac9ab7e849b9 tempest-TestVolumeBootPattern-910285030 None] attachment_update completed successfully. Apr 14 03:12:59 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:12:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Flow 'volume_create_manager' (2fce2ba7-cc8d-434d-98de-2ec6baae228d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:12:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a83b709-931e-4318-ad2c-3e02e965f7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a83b709-931e-4318-ad2c-3e02e965f7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-307484876',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=79327c39-9a3e-49d7-9547-fe4e5312d22e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c983a366df184d96bbe3cd18382ea141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:13:00Z,use_quota=True,user_id='1ad729020d8d41dc9b89e556cb08ed9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e598231-59de-45df-ab2e-dba74b28996c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e598231-59de-45df-ab2e-dba74b28996c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1bb933-8c70-4f10-aa6d-4f350f430824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1bb933-8c70-4f10-aa6d-4f350f430824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79327c39-9a3e-49d7-9547-fe4e5312d22e', 'volume_name': 'volume-79327c39-9a3e-49d7-9547-fe4e5312d22e', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20ab126-2021-45ba-a830-ca8afc845716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20ab126-2021-45ba-a830-ca8afc845716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:12:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f207c1c0-963c-4f5f-bc88-1660d09f1bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:12:59 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Volume 79327c39-9a3e-49d7-9547-fe4e5312d22e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79327c39-9a3e-49d7-9547-fe4e5312d22e', 'volume_size': 1} Apr 14 03:12:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] creating volume v_79327c39-9a3e-49d7-9547-fe4e5312d22e. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:12:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] create volume {'name': 'v_79327c39-9a3e-49d7-9547-fe4e5312d22e', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:12:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:12:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_79327c39-9a3e-49d7-9547-fe4e5312d22e', 'is_clone': False, 'name': 'v_79327c39-9a3e-49d7-9547-fe4e5312d22e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f207c1c0-963c-4f5f-bc88-1660d09f1bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79327c39-9a3e-49d7-9547-fe4e5312d22e', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:13:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e488c2ba-95e2-4aad-aefa-209f3e067236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:13:00 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Volume volume-79327c39-9a3e-49d7-9547-fe4e5312d22e (79327c39-9a3e-49d7-9547-fe4e5312d22e): created successfully Apr 14 03:13:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e488c2ba-95e2-4aad-aefa-209f3e067236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:13:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Flow 'volume_create_manager' (2fce2ba7-cc8d-434d-98de-2ec6baae228d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:13:00 user cinder-volume[73403]: INFO cinder.volume.manager [None req-65dfaf25-ad16-4e5c-9a60-910462344856 tempest-VolumesGetTest-230534178 None] Created volume successfully. Apr 14 03:13:00 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:INSERT=19,cinder:SELECT=54,cinder:UPDATE=25,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:01 user cinder-volume[73403]: DEBUG cinder.coordination [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Acquiring lock "cinder-79327c39-9a3e-49d7-9547-fe4e5312d22e-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:13:01 user cinder-volume[73403]: DEBUG cinder.coordination [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Lock "cinder-79327c39-9a3e-49d7-9547-fe4e5312d22e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:13:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] remove_export for volume: 79327c39-9a3e-49d7-9547-fe4e5312d22e. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:13:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:13:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1745670955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=79327c39-9a3e-49d7-9547-fe4e5312d22e,launched_at=2023-04-14T03:13:01Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c983a366df184d96bbe3cd18382ea141',provider_auth='CHAP gefaWZNs QafbVWjsGcZL67',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:79327c39-9a3e-49d7-9547-fe4e5312d22e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:13:00Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:13:02Z,updated_at=2023-04-14T03:13:02Z,use_quota=True,user_id='1ad729020d8d41dc9b89e556cb08ed9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:79327c39-9a3e-49d7-9547-fe4e5312d22e. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:13:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] detach volume v_79327c39-9a3e-49d7-9547-fe4e5312d22e from target iqn.2010-10.org.openstack:79327c39-9a3e-49d7-9547-fe4e5312d22e {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:13:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:79327c39-9a3e-49d7-9547-fe4e5312d22e/luns/v_79327c39-9a3e-49d7-9547-fe4e5312d22e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:79327c39-9a3e-49d7-9547-fe4e5312d22e/luns/v_79327c39-9a3e-49d7-9547-fe4e5312d22e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:79327c39-9a3e-49d7-9547-fe4e5312d22e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:79327c39-9a3e-49d7-9547-fe4e5312d22e/luns/v_79327c39-9a3e-49d7-9547-fe4e5312d22e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:79327c39-9a3e-49d7-9547-fe4e5312d22e/luns/v_79327c39-9a3e-49d7-9547-fe4e5312d22e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] failed to remove resource iqn.2010-10.org.openstack:79327c39-9a3e-49d7-9547-fe4e5312d22e because of JDSS resource v_79327c39-9a3e-49d7-9547-fe4e5312d22e DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:13:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] delete target: iqn.2010-10.org.openstack:79327c39-9a3e-49d7-9547-fe4e5312d22e {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:13:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] delete target iqn.2010-10.org.openstack:79327c39-9a3e-49d7-9547-fe4e5312d22e {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:13:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:79327c39-9a3e-49d7-9547-fe4e5312d22e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:79327c39-9a3e-49d7-9547-fe4e5312d22e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:79327c39-9a3e-49d7-9547-fe4e5312d22e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:79327c39-9a3e-49d7-9547-fe4e5312d22e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:79327c39-9a3e-49d7-9547-fe4e5312d22e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] failed to remove resource iqn.2010-10.org.openstack:79327c39-9a3e-49d7-9547-fe4e5312d22e because of JDSS resource iqn.2010-10.org.openstack:79327c39-9a3e-49d7-9547-fe4e5312d22e DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:13:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] deleating volume v_79327c39-9a3e-49d7-9547-fe4e5312d22e {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:13:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] get snapshots for volume v_79327c39-9a3e-49d7-9547-fe4e5312d22e {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:13:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_79327c39-9a3e-49d7-9547-fe4e5312d22e/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_79327c39-9a3e-49d7-9547-fe4e5312d22e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_79327c39-9a3e-49d7-9547-fe4e5312d22e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] get volume v_79327c39-9a3e-49d7-9547-fe4e5312d22e info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:13:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_79327c39-9a3e-49d7-9547-fe4e5312d22e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_79327c39-9a3e-49d7-9547-fe4e5312d22e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_79327c39-9a3e-49d7-9547-fe4e5312d22e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443389', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113361', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6307464105591886232', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3584e2fb7506b386', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276007936', 'san:volume_id': '3584e2fb7506b3867ce192d0b1c9fb567dcf7360', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84719', 'name': 'v_79327c39-9a3e-49d7-9547-fe4e5312d22e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_79327c39-9a3e-49d7-9547-fe4e5312d22e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] delete volume:v_79327c39-9a3e-49d7-9547-fe4e5312d22e recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:13:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_79327c39-9a3e-49d7-9547-fe4e5312d22e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_79327c39-9a3e-49d7-9547-fe4e5312d22e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:13:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:13:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:13:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276077568', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:13:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:13:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_79327c39-9a3e-49d7-9547-fe4e5312d22e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] volume v_79327c39-9a3e-49d7-9547-fe4e5312d22e deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:13:04 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=63,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=8 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:04 user cinder-volume[73403]: DEBUG cinder.quota [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Created reservations ['05f719d4-9a41-4ed1-9b91-2ae38c5642d1', '616037e1-0cc4-48f2-b0bd-98f2310728f1', 'f58e9b54-ac9a-4d1f-b7ef-af6a94eccaa1', 'fb56cc53-a838-4899-8bbc-b40d8d7dea1f'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:13:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:13:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:13:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276077568', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.manager [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:13:05 user cinder-volume[73403]: INFO cinder.volume.manager [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Deleted volume successfully. Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.coordination [None req-d669edc4-a09f-40f8-95fa-dbd7b393656b tempest-VolumesGetTest-230534178 None] Lock "cinder-79327c39-9a3e-49d7-9547-fe4e5312d22e-delete_volume" released by "delete_volume" :: held 3.415s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Acquiring lock "cinder-9fa66191-eab2-427b-9270-9a000e40caa1-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Lock "cinder-9fa66191-eab2-427b-9270-9a000e40caa1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] remove_export for volume: 9fa66191-eab2-427b-9270-9a000e40caa1. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:55Z,deleted=False,deleted_at=None,display_description='This is the new description of volume',display_name='tempest-VolumesGetTest-new-Volume-603482973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9fa66191-eab2-427b-9270-9a000e40caa1,launched_at=2023-04-14T03:12:58Z,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c983a366df184d96bbe3cd18382ea141',provider_auth='CHAP AZmcEHgo HIzveBNcKZGjSg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa66191-eab2-427b-9270-9a000e40caa1 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:12:55Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:13:05Z,updated_at=2023-04-14T03:13:05Z,use_quota=True,user_id='1ad729020d8d41dc9b89e556cb08ed9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:9fa66191-eab2-427b-9270-9a000e40caa1. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] detach volume v_9fa66191-eab2-427b-9270-9a000e40caa1 from target iqn.2010-10.org.openstack:9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9fa66191-eab2-427b-9270-9a000e40caa1/luns/v_9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9fa66191-eab2-427b-9270-9a000e40caa1/luns/v_9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9fa66191-eab2-427b-9270-9a000e40caa1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9fa66191-eab2-427b-9270-9a000e40caa1/luns/v_9fa66191-eab2-427b-9270-9a000e40caa1'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9fa66191-eab2-427b-9270-9a000e40caa1/luns/v_9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] failed to remove resource iqn.2010-10.org.openstack:9fa66191-eab2-427b-9270-9a000e40caa1 because of JDSS resource v_9fa66191-eab2-427b-9270-9a000e40caa1 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] delete target: iqn.2010-10.org.openstack:9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] delete target iqn.2010-10.org.openstack:9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9fa66191-eab2-427b-9270-9a000e40caa1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9fa66191-eab2-427b-9270-9a000e40caa1'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] failed to remove resource iqn.2010-10.org.openstack:9fa66191-eab2-427b-9270-9a000e40caa1 because of JDSS resource iqn.2010-10.org.openstack:9fa66191-eab2-427b-9270-9a000e40caa1 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] deleating volume v_9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] get snapshots for volume v_9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9fa66191-eab2-427b-9270-9a000e40caa1/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9fa66191-eab2-427b-9270-9a000e40caa1/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9fa66191-eab2-427b-9270-9a000e40caa1/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] get volume v_9fa66191-eab2-427b-9270-9a000e40caa1 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_9fa66191-eab2-427b-9270-9a000e40caa1', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9fa66191-eab2-427b-9270-9a000e40caa1', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443385', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '113353', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16306877213952085397', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7ff4defb0cb46a69', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276077568', 'san:volume_id': '7ff4defb0cb46a69e0d214baae28fb72e9d32e84', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85240', 'name': 'v_9fa66191-eab2-427b-9270-9a000e40caa1', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] delete snapshot v_9fa66191-eab2-427b-9270-9a000e40caa1 of volume v_482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_9fa66191-eab2-427b-9270-9a000e40caa1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] snapshot v_9fa66191-eab2-427b-9270-9a000e40caa1 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:13:07 user cinder-volume[73403]: DEBUG cinder.quota [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Created reservations ['5399890e-3850-470a-9896-5fa16cb88a17', '7d88e7ed-e14f-4cf9-af76-c5540a9b81c1', '93925bd6-9944-4648-853b-558c4f0e4a40', 'ea7c04b5-5a8a-47fb-a04f-62addf1fce42'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:13:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:13:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:13:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276126720', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:13:08 user cinder-volume[73403]: DEBUG cinder.manager [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:13:08 user cinder-volume[73403]: INFO cinder.volume.manager [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Deleted volume successfully. Apr 14 03:13:08 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7bde5aeb-c5e6-4816-b580-e6d839741bea tempest-VolumesGetTest-230534178 None] Lock "cinder-9fa66191-eab2-427b-9270-9a000e40caa1-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:13:10 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:13:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Flow 'volume_create_manager' (6c9ec040-6572-480d-be9a-8f3c6125fa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:13:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11312744-5646-4c5d-86df-75a6757f8207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:13:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11312744-5646-4c5d-86df-75a6757f8207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-963204618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=130493b4-d578-4046-9d78-07c4acc9d5a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb475f2de9b049dc933d0aedbd68f128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:13:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:13:11Z,use_quota=True,user_id='6b5d53c447b24396ac3f4c845777560b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:13:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18dc2e5f-c940-41fc-a987-4c85b1f5189d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:13:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18dc2e5f-c940-41fc-a987-4c85b1f5189d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:13:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6cc424e-6fe0-4100-a39d-403b9988979f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:13:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6cc424e-6fe0-4100-a39d-403b9988979f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '130493b4-d578-4046-9d78-07c4acc9d5a8', 'volume_name': 'volume-130493b4-d578-4046-9d78-07c4acc9d5a8', 'volume_size': 2}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:13:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38408606-5566-4bab-a70e-f2aa7393ffba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:13:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38408606-5566-4bab-a70e-f2aa7393ffba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:13:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5494abe-4fc2-46af-a1b5-2c11c3cd4d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:13:10 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Volume 130493b4-d578-4046-9d78-07c4acc9d5a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-130493b4-d578-4046-9d78-07c4acc9d5a8', 'volume_size': 2} Apr 14 03:13:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] creating volume v_130493b4-d578-4046-9d78-07c4acc9d5a8. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:13:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] create volume {'name': 'v_130493b4-d578-4046-9d78-07c4acc9d5a8', 'size': '2147483648', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:13:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_130493b4-d578-4046-9d78-07c4acc9d5a8', 'is_clone': False, 'name': 'v_130493b4-d578-4046-9d78-07c4acc9d5a8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5494abe-4fc2-46af-a1b5-2c11c3cd4d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-130493b4-d578-4046-9d78-07c4acc9d5a8', 'volume_size': 2}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:13:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60645e63-3c32-4bcd-ac1f-961a8c9a97e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:13:11 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Volume volume-130493b4-d578-4046-9d78-07c4acc9d5a8 (130493b4-d578-4046-9d78-07c4acc9d5a8): created successfully Apr 14 03:13:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60645e63-3c32-4bcd-ac1f-961a8c9a97e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:13:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Flow 'volume_create_manager' (6c9ec040-6572-480d-be9a-8f3c6125fa11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:13:11 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8886f332-52dc-4f1c-8664-d51e0fae2a62 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Created volume successfully. Apr 14 03:13:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dc2958b3-5768-43f7-aa1d-6c9039cf14e7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] create snapshot f2c0a94b-0ddb-4249-baf5-62dd24caf81e for volume 130493b4-d578-4046-9d78-07c4acc9d5a8 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:13:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dc2958b3-5768-43f7-aa1d-6c9039cf14e7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] cloning v_130493b4-d578-4046-9d78-07c4acc9d5a8 to s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:13:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dc2958b3-5768-43f7-aa1d-6c9039cf14e7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] create snapshot s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:13:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc2958b3-5768-43f7-aa1d-6c9039cf14e7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_130493b4-d578-4046-9d78-07c4acc9d5a8/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc2958b3-5768-43f7-aa1d-6c9039cf14e7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_130493b4-d578-4046-9d78-07c4acc9d5a8/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc2958b3-5768-43f7-aa1d-6c9039cf14e7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_f2c0a94b-0ddb-4249-baf5-62dd24caf81e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_130493b4-d578-4046-9d78-07c4acc9d5a8/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dc2958b3-5768-43f7-aa1d-6c9039cf14e7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] create volume s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e from snapshot s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:13:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc2958b3-5768-43f7-aa1d-6c9039cf14e7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_130493b4-d578-4046-9d78-07c4acc9d5a8/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc2958b3-5768-43f7-aa1d-6c9039cf14e7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_130493b4-d578-4046-9d78-07c4acc9d5a8/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc2958b3-5768-43f7-aa1d-6c9039cf14e7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_130493b4-d578-4046-9d78-07c4acc9d5a8@s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e', 'is_clone': True, 'full_name': 'Pool-0/s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e', 'name': 's_f2c0a94b-0ddb-4249-baf5-62dd24caf81e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_130493b4-d578-4046-9d78-07c4acc9d5a8/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc2958b3-5768-43f7-aa1d-6c9039cf14e7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc2958b3-5768-43f7-aa1d-6c9039cf14e7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dc2958b3-5768-43f7-aa1d-6c9039cf14e7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dc2958b3-5768-43f7-aa1d-6c9039cf14e7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] volume s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:13:14 user cinder-volume[73403]: INFO cinder.volume.manager [None req-dc2958b3-5768-43f7-aa1d-6c9039cf14e7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Create snapshot completed successfully Apr 14 03:13:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-1d38200e-ce65-46f7-9b02-83e88bfd5311 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Acquiring lock "cinder-f2c0a94b-0ddb-4249-baf5-62dd24caf81e-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:13:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-1d38200e-ce65-46f7-9b02-83e88bfd5311 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Lock "cinder-f2c0a94b-0ddb-4249-baf5-62dd24caf81e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:13:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d38200e-ce65-46f7-9b02-83e88bfd5311 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] deleating snapshot s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:13:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d38200e-ce65-46f7-9b02-83e88bfd5311 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] get snapshots for volume s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:13:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d38200e-ce65-46f7-9b02-83e88bfd5311 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d38200e-ce65-46f7-9b02-83e88bfd5311 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d38200e-ce65-46f7-9b02-83e88bfd5311 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d38200e-ce65-46f7-9b02-83e88bfd5311 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] get volume s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:13:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d38200e-ce65-46f7-9b02-83e88bfd5311 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d38200e-ce65-46f7-9b02-83e88bfd5311 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d38200e-ce65-46f7-9b02-83e88bfd5311 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_130493b4-d578-4046-9d78-07c4acc9d5a8@s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443403', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113374', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9423888208609102521', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '70f35909fbcc2f28', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275741696', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85426', 'name': 's_f2c0a94b-0ddb-4249-baf5-62dd24caf81e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d38200e-ce65-46f7-9b02-83e88bfd5311 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] delete snapshot s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e of volume v_130493b4-d578-4046-9d78-07c4acc9d5a8 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:13:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d38200e-ce65-46f7-9b02-83e88bfd5311 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_130493b4-d578-4046-9d78-07c4acc9d5a8/snapshots/s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d38200e-ce65-46f7-9b02-83e88bfd5311 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_130493b4-d578-4046-9d78-07c4acc9d5a8/snapshots/s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d38200e-ce65-46f7-9b02-83e88bfd5311 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_130493b4-d578-4046-9d78-07c4acc9d5a8/snapshots/s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d38200e-ce65-46f7-9b02-83e88bfd5311 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] snapshot s_f2c0a94b-0ddb-4249-baf5-62dd24caf81e deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:13:18 user cinder-volume[73403]: DEBUG cinder.quota [None req-1d38200e-ce65-46f7-9b02-83e88bfd5311 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Created reservations ['17e7786d-848b-4320-b52d-d8326b50aeee', '20eb5b51-bfb1-4651-bd52-f069b5cceccf', '14456413-897a-4a6d-a002-e5d51072854e', '8ca4093b-6cc4-43f5-9ece-57a83190a089'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:13:18 user cinder-volume[73403]: INFO cinder.volume.manager [None req-1d38200e-ce65-46f7-9b02-83e88bfd5311 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Delete snapshot completed successfully. Apr 14 03:13:18 user cinder-volume[73403]: DEBUG cinder.coordination [None req-1d38200e-ce65-46f7-9b02-83e88bfd5311 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Lock "cinder-f2c0a94b-0ddb-4249-baf5-62dd24caf81e-delete_snapshot" released by "delete_snapshot" :: held 2.532s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.coordination [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Acquiring lock "cinder-130493b4-d578-4046-9d78-07c4acc9d5a8-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.coordination [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Lock "cinder-130493b4-d578-4046-9d78-07c4acc9d5a8-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] remove_export for volume: 130493b4-d578-4046-9d78-07c4acc9d5a8. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-963204618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=130493b4-d578-4046-9d78-07c4acc9d5a8,launched_at=2023-04-14T03:13:12Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb475f2de9b049dc933d0aedbd68f128',provider_auth='CHAP EnedvcRs wKz2Z37jYCRNgm',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:130493b4-d578-4046-9d78-07c4acc9d5a8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:13:11Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:13:19Z,updated_at=2023-04-14T03:13:19Z,use_quota=True,user_id='6b5d53c447b24396ac3f4c845777560b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:130493b4-d578-4046-9d78-07c4acc9d5a8. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] detach volume v_130493b4-d578-4046-9d78-07c4acc9d5a8 from target iqn.2010-10.org.openstack:130493b4-d578-4046-9d78-07c4acc9d5a8 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:130493b4-d578-4046-9d78-07c4acc9d5a8/luns/v_130493b4-d578-4046-9d78-07c4acc9d5a8 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:130493b4-d578-4046-9d78-07c4acc9d5a8/luns/v_130493b4-d578-4046-9d78-07c4acc9d5a8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:130493b4-d578-4046-9d78-07c4acc9d5a8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:130493b4-d578-4046-9d78-07c4acc9d5a8/luns/v_130493b4-d578-4046-9d78-07c4acc9d5a8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:130493b4-d578-4046-9d78-07c4acc9d5a8/luns/v_130493b4-d578-4046-9d78-07c4acc9d5a8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] failed to remove resource iqn.2010-10.org.openstack:130493b4-d578-4046-9d78-07c4acc9d5a8 because of JDSS resource v_130493b4-d578-4046-9d78-07c4acc9d5a8 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] delete target: iqn.2010-10.org.openstack:130493b4-d578-4046-9d78-07c4acc9d5a8 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] delete target iqn.2010-10.org.openstack:130493b4-d578-4046-9d78-07c4acc9d5a8 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:130493b4-d578-4046-9d78-07c4acc9d5a8 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:130493b4-d578-4046-9d78-07c4acc9d5a8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:130493b4-d578-4046-9d78-07c4acc9d5a8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:130493b4-d578-4046-9d78-07c4acc9d5a8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:130493b4-d578-4046-9d78-07c4acc9d5a8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] failed to remove resource iqn.2010-10.org.openstack:130493b4-d578-4046-9d78-07c4acc9d5a8 because of JDSS resource iqn.2010-10.org.openstack:130493b4-d578-4046-9d78-07c4acc9d5a8 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] deleating volume v_130493b4-d578-4046-9d78-07c4acc9d5a8 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] get snapshots for volume v_130493b4-d578-4046-9d78-07c4acc9d5a8 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_130493b4-d578-4046-9d78-07c4acc9d5a8/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_130493b4-d578-4046-9d78-07c4acc9d5a8/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_130493b4-d578-4046-9d78-07c4acc9d5a8/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] get volume v_130493b4-d578-4046-9d78-07c4acc9d5a8 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_130493b4-d578-4046-9d78-07c4acc9d5a8 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_130493b4-d578-4046-9d78-07c4acc9d5a8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_130493b4-d578-4046-9d78-07c4acc9d5a8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443400', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113368', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16688610005794898553', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '23072e0a1dc49302', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275713024', 'san:volume_id': '23072e0a1dc4930297de5ca425b9a8d3a1f91575', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85866', 'name': 'v_130493b4-d578-4046-9d78-07c4acc9d5a8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_130493b4-d578-4046-9d78-07c4acc9d5a8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] delete volume:v_130493b4-d578-4046-9d78-07c4acc9d5a8 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_130493b4-d578-4046-9d78-07c4acc9d5a8 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_130493b4-d578-4046-9d78-07c4acc9d5a8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_130493b4-d578-4046-9d78-07c4acc9d5a8 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] volume v_130493b4-d578-4046-9d78-07c4acc9d5a8 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:13:21 user cinder-volume[73403]: DEBUG cinder.quota [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Created reservations ['28dad460-b17a-4bf9-b4a6-6ef8a0720923', 'b2c76b78-71cc-4f6b-869d-60091a48527e', '3c71c32c-c6b1-4343-9bf8-43452574ee5e', 'db4007bd-239e-43f6-9cf1-dd59edcb8201'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:13:21 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=60,cinder:UPDATE=34,cinder:INSERT=4,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:13:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:13:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Geting {'code': 200, 'error': None, 'data': {'available': '114275749888', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:13:22 user cinder-volume[73403]: DEBUG cinder.manager [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:13:22 user cinder-volume[73403]: INFO cinder.volume.manager [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Deleted volume successfully. Apr 14 03:13:22 user cinder-volume[73403]: DEBUG cinder.coordination [None req-0f4c65d1-7076-48d3-87d6-cd9f534716d7 tempest-VolumesSnapshotNegativeTestJSON-673695599 None] Lock "cinder-130493b4-d578-4046-9d78-07c4acc9d5a8-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:13:42 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=32,cinder:SELECT=47,cinder:INSERT=9,cinder:DELETE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] create export for volume: eb69c0bd-af4f-438c-b96a-94c59261813a. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:13:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] ensure volume eb69c0bd-af4f-438c-b96a-94c59261813a assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:13:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] check if targe iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:13:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] create target and attach volume eb69c0bd-af4f-438c-b96a-94c59261813a to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:13:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] create target iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:13:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] atach volume v_eb69c0bd-af4f-438c-b96a-94c59261813a to target iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:13:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6130316163326664', 'lun': 0, 'mode': 'wt', 'name': 'v_eb69c0bd-af4f-438c-b96a-94c59261813a', 'prod_id': 'Storage', 'scsi_id': 'a01ac2fd9f613482'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] add credentails to target iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:13:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 201, 'error': None, 'data': {'name': 'pjXgqBiH'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] initialize_connection for eb69c0bd-af4f-438c-b96a-94c59261813a 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:13:46 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjXgqBiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '84b39d34-19fb-4a0d-98ba-939032766d98'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:13:46 user cinder-volume[73403]: INFO cinder.volume.manager [req-e7ead739-5a9a-4e01-ae56-98a99efbb448 req-64730c19-b208-47db-9bac-be909037b7fd tempest-VolumesSnapshotTestJSON-423841644 None] attachment_update completed successfully. Apr 14 03:13:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a44f5437-da07-4a34-916b-3461069b43cf tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot cbe6d01e-e4fd-4624-9f34-4170f986c3ca for volume eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:13:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a44f5437-da07-4a34-916b-3461069b43cf tempest-VolumesSnapshotTestJSON-423841644 None] cloning v_eb69c0bd-af4f-438c-b96a-94c59261813a to s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:13:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a44f5437-da07-4a34-916b-3461069b43cf tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:13:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a44f5437-da07-4a34-916b-3461069b43cf tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a44f5437-da07-4a34-916b-3461069b43cf tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a44f5437-da07-4a34-916b-3461069b43cf tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_cbe6d01e-e4fd-4624-9f34-4170f986c3ca'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a44f5437-da07-4a34-916b-3461069b43cf tempest-VolumesSnapshotTestJSON-423841644 None] create volume s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca from snapshot s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:13:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a44f5437-da07-4a34-916b-3461069b43cf tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a44f5437-da07-4a34-916b-3461069b43cf tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Flow 'volume_create_manager' (41939322-8339-4b31-b174-2baebf69a66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a27d3d-8d52-4cbc-bef8-278084d50cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a27d3d-8d52-4cbc-bef8-278084d50cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1347917722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7fff5d89-4516-4be1-9698-f088498889ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82eb4fbf55f04294a3d97800142bdca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:13:51Z,use_quota=True,user_id='3c683fe5636b49858857033797ff8e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e52d48-c253-4b59-8af2-e4f5ff7b05b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e52d48-c253-4b59-8af2-e4f5ff7b05b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f0f43c-7c75-4e52-a917-8c25f0cbac72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f0f43c-7c75-4e52-a917-8c25f0cbac72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fff5d89-4516-4be1-9698-f088498889ff', 'volume_name': 'volume-7fff5d89-4516-4be1-9698-f088498889ff', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd4e4af-2b5d-48e6-9a0e-01e70b00bab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd4e4af-2b5d-48e6-9a0e-01e70b00bab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad3b81c-a3ba-41fe-b137-fdc9ac8d6d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:13:51 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Volume 7fff5d89-4516-4be1-9698-f088498889ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fff5d89-4516-4be1-9698-f088498889ff', 'volume_size': 1} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] creating volume v_7fff5d89-4516-4be1-9698-f088498889ff. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] create volume {'name': 'v_7fff5d89-4516-4be1-9698-f088498889ff', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a44f5437-da07-4a34-916b-3461069b43cf tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_eb69c0bd-af4f-438c-b96a-94c59261813a@s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca', 'is_clone': True, 'full_name': 'Pool-0/s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca', 'name': 's_cbe6d01e-e4fd-4624-9f34-4170f986c3ca'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a44f5437-da07-4a34-916b-3461069b43cf tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a44f5437-da07-4a34-916b-3461069b43cf tempest-VolumesSnapshotTestJSON-423841644 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a44f5437-da07-4a34-916b-3461069b43cf tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a44f5437-da07-4a34-916b-3461069b43cf tempest-VolumesSnapshotTestJSON-423841644 None] volume s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:13:51 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=23,cinder:UPDATE=5 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:13:52 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a44f5437-da07-4a34-916b-3461069b43cf tempest-VolumesSnapshotTestJSON-423841644 None] Create snapshot completed successfully Apr 14 03:13:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_7fff5d89-4516-4be1-9698-f088498889ff', 'is_clone': False, 'name': 'v_7fff5d89-4516-4be1-9698-f088498889ff'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad3b81c-a3ba-41fe-b137-fdc9ac8d6d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fff5d89-4516-4be1-9698-f088498889ff', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:13:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35b0674-8d19-4801-8193-46198b2a79ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:13:52 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Volume volume-7fff5d89-4516-4be1-9698-f088498889ff (7fff5d89-4516-4be1-9698-f088498889ff): created successfully Apr 14 03:13:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35b0674-8d19-4801-8193-46198b2a79ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:13:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Flow 'volume_create_manager' (41939322-8339-4b31-b174-2baebf69a66a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:13:52 user cinder-volume[73403]: INFO cinder.volume.manager [None req-aec2edad-7b07-4741-be6c-3041c1359640 tempest-ServerStableDeviceRescueTest-1642713032 None] Created volume successfully. Apr 14 03:13:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b22aec22-4a93-4883-850f-e9732430dd50 tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot 1573dd73-4ee2-49e7-a82f-c8136036685b for volume eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:13:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b22aec22-4a93-4883-850f-e9732430dd50 tempest-VolumesSnapshotTestJSON-423841644 None] cloning v_eb69c0bd-af4f-438c-b96a-94c59261813a to s_1573dd73-4ee2-49e7-a82f-c8136036685b {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:13:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b22aec22-4a93-4883-850f-e9732430dd50 tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot s_1573dd73-4ee2-49e7-a82f-c8136036685b {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:13:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b22aec22-4a93-4883-850f-e9732430dd50 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b22aec22-4a93-4883-850f-e9732430dd50 tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b22aec22-4a93-4883-850f-e9732430dd50 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_1573dd73-4ee2-49e7-a82f-c8136036685b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b22aec22-4a93-4883-850f-e9732430dd50 tempest-VolumesSnapshotTestJSON-423841644 None] create volume s_1573dd73-4ee2-49e7-a82f-c8136036685b from snapshot s_1573dd73-4ee2-49e7-a82f-c8136036685b {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:13:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b22aec22-4a93-4883-850f-e9732430dd50 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b22aec22-4a93-4883-850f-e9732430dd50 tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] create export for volume: 7fff5d89-4516-4be1-9698-f088498889ff. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:13:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] ensure volume 7fff5d89-4516-4be1-9698-f088498889ff assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:13:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] check if targe iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:13:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] create target and attach volume 7fff5d89-4516-4be1-9698-f088498889ff to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:13:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] create target iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:13:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b22aec22-4a93-4883-850f-e9732430dd50 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_eb69c0bd-af4f-438c-b96a-94c59261813a@s_1573dd73-4ee2-49e7-a82f-c8136036685b', 'is_clone': True, 'full_name': 'Pool-0/s_1573dd73-4ee2-49e7-a82f-c8136036685b', 'name': 's_1573dd73-4ee2-49e7-a82f-c8136036685b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b22aec22-4a93-4883-850f-e9732430dd50 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1573dd73-4ee2-49e7-a82f-c8136036685b/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b22aec22-4a93-4883-850f-e9732430dd50 tempest-VolumesSnapshotTestJSON-423841644 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1573dd73-4ee2-49e7-a82f-c8136036685b/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b22aec22-4a93-4883-850f-e9732430dd50 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1573dd73-4ee2-49e7-a82f-c8136036685b/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b22aec22-4a93-4883-850f-e9732430dd50 tempest-VolumesSnapshotTestJSON-423841644 None] volume s_1573dd73-4ee2-49e7-a82f-c8136036685b properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:13:54 user cinder-volume[73403]: INFO cinder.volume.manager [None req-b22aec22-4a93-4883-850f-e9732430dd50 tempest-VolumesSnapshotTestJSON-423841644 None] Create snapshot completed successfully Apr 14 03:13:54 user cinder-volume[73403]: DEBUG cinder.coordination [None req-827601c3-9f27-4ecc-a101-af6a618ddf6d tempest-VolumesSnapshotTestJSON-423841644 None] Acquiring lock "cinder-1573dd73-4ee2-49e7-a82f-c8136036685b-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:13:54 user cinder-volume[73403]: DEBUG cinder.coordination [None req-827601c3-9f27-4ecc-a101-af6a618ddf6d tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-1573dd73-4ee2-49e7-a82f-c8136036685b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:13:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-827601c3-9f27-4ecc-a101-af6a618ddf6d tempest-VolumesSnapshotTestJSON-423841644 None] deleating snapshot s_1573dd73-4ee2-49e7-a82f-c8136036685b. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:13:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-827601c3-9f27-4ecc-a101-af6a618ddf6d tempest-VolumesSnapshotTestJSON-423841644 None] get snapshots for volume s_1573dd73-4ee2-49e7-a82f-c8136036685b {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:13:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-827601c3-9f27-4ecc-a101-af6a618ddf6d tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1573dd73-4ee2-49e7-a82f-c8136036685b/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-827601c3-9f27-4ecc-a101-af6a618ddf6d tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1573dd73-4ee2-49e7-a82f-c8136036685b/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-827601c3-9f27-4ecc-a101-af6a618ddf6d tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1573dd73-4ee2-49e7-a82f-c8136036685b/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-827601c3-9f27-4ecc-a101-af6a618ddf6d tempest-VolumesSnapshotTestJSON-423841644 None] get volume s_1573dd73-4ee2-49e7-a82f-c8136036685b info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:13:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-827601c3-9f27-4ecc-a101-af6a618ddf6d tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1573dd73-4ee2-49e7-a82f-c8136036685b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-827601c3-9f27-4ecc-a101-af6a618ddf6d tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1573dd73-4ee2-49e7-a82f-c8136036685b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-827601c3-9f27-4ecc-a101-af6a618ddf6d tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_eb69c0bd-af4f-438c-b96a-94c59261813a@s_1573dd73-4ee2-49e7-a82f-c8136036685b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_1573dd73-4ee2-49e7-a82f-c8136036685b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443443', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113404', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16914461812644549562', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a48f648ebb2e8d26', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275610624', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84829', 'name': 's_1573dd73-4ee2-49e7-a82f-c8136036685b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1573dd73-4ee2-49e7-a82f-c8136036685b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-827601c3-9f27-4ecc-a101-af6a618ddf6d tempest-VolumesSnapshotTestJSON-423841644 None] delete snapshot s_1573dd73-4ee2-49e7-a82f-c8136036685b of volume v_eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:13:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-827601c3-9f27-4ecc-a101-af6a618ddf6d tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots/s_1573dd73-4ee2-49e7-a82f-c8136036685b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-827601c3-9f27-4ecc-a101-af6a618ddf6d tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots/s_1573dd73-4ee2-49e7-a82f-c8136036685b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.coordination [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Acquiring lock "cinder-05d362e8-1aaf-4bbb-8a9f-9f153920e00c-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.coordination [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Lock "cinder-05d362e8-1aaf-4bbb-8a9f-9f153920e00c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] remove_export for volume: 05d362e8-1aaf-4bbb-8a9f-9f153920e00c. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-509802863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=05d362e8-1aaf-4bbb-8a9f-9f153920e00c,launched_at=2023-04-14T03:06:26Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='558bfd7e1d9049d396381de148b0c4a5',provider_auth='CHAP KcHRlyjP siBXDKM287E9uC',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:06:25Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:13:56Z,updated_at=2023-04-14T03:13:56Z,use_quota=True,user_id='d5e8150f1502427fb3148f20354d212e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] detach volume v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c from target iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c/luns/v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c/luns/v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c/luns/v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c/luns/v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] failed to remove resource iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c because of JDSS resource v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] delete target: iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] delete target iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] failed to remove resource iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c because of JDSS resource iqn.2010-10.org.openstack:05d362e8-1aaf-4bbb-8a9f-9f153920e00c DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] deleating volume v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] get snapshots for volume v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] atach volume v_7fff5d89-4516-4be1-9698-f088498889ff to target iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] get volume v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442994', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113002', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14332149156542810475', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e13eca89c9d649d0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275610624', 'san:volume_id': 'e13eca89c9d649d0bb4b4d1629a348b043cff9ec', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85897', 'name': 'v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] delete volume:v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-827601c3-9f27-4ecc-a101-af6a618ddf6d tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots/s_1573dd73-4ee2-49e7-a82f-c8136036685b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-827601c3-9f27-4ecc-a101-af6a618ddf6d tempest-VolumesSnapshotTestJSON-423841644 None] snapshot s_1573dd73-4ee2-49e7-a82f-c8136036685b deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:13:57 user cinder-volume[73403]: DEBUG cinder.quota [None req-827601c3-9f27-4ecc-a101-af6a618ddf6d tempest-VolumesSnapshotTestJSON-423841644 None] Created reservations ['c6a8b2f3-9a39-44dd-a3d3-941452978036', 'bf2c2429-95bb-43f5-9017-46162d87058b', '53b7a048-4cf1-4665-a59f-e19206c88f7f', '66eaffb8-1eca-4be5-a956-5d095a0bb747'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:13:57 user cinder-volume[73403]: INFO cinder.volume.manager [None req-827601c3-9f27-4ecc-a101-af6a618ddf6d tempest-VolumesSnapshotTestJSON-423841644 None] Delete snapshot completed successfully. Apr 14 03:13:57 user cinder-volume[73403]: DEBUG cinder.coordination [None req-827601c3-9f27-4ecc-a101-af6a618ddf6d tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-1573dd73-4ee2-49e7-a82f-c8136036685b-delete_snapshot" released by "delete_snapshot" :: held 2.699s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3062626637306135', 'lun': 0, 'mode': 'wt', 'name': 'v_7fff5d89-4516-4be1-9698-f088498889ff', 'prod_id': 'Storage', 'scsi_id': '0bbf70a599fb731d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] add credentails to target iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.coordination [None req-3c599362-8d4e-4d28-80e2-831748f08cdd tempest-VolumesSnapshotTestJSON-423841644 None] Acquiring lock "cinder-4baed33f-013a-45e2-b4bf-36add0ac5c86-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.coordination [None req-3c599362-8d4e-4d28-80e2-831748f08cdd tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-4baed33f-013a-45e2-b4bf-36add0ac5c86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3c599362-8d4e-4d28-80e2-831748f08cdd tempest-VolumesSnapshotTestJSON-423841644 None] deleating snapshot s_4baed33f-013a-45e2-b4bf-36add0ac5c86. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3c599362-8d4e-4d28-80e2-831748f08cdd tempest-VolumesSnapshotTestJSON-423841644 None] get snapshots for volume s_4baed33f-013a-45e2-b4bf-36add0ac5c86 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c599362-8d4e-4d28-80e2-831748f08cdd tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4baed33f-013a-45e2-b4bf-36add0ac5c86/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c599362-8d4e-4d28-80e2-831748f08cdd tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4baed33f-013a-45e2-b4bf-36add0ac5c86/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] Geting {'code': 201, 'error': None, 'data': {'name': 'weNMmovz'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] initialize_connection for 7fff5d89-4516-4be1-9698-f088498889ff 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'weNMmovz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '6bc4d910-81cd-4cad-b971-4d1cd3ba9cf2'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:13:58 user cinder-volume[73403]: INFO cinder.volume.manager [req-6f19d01f-dddd-4d94-91e5-83ef56bcf2cf req-a6839262-519f-4f8d-a742-141e4049abd6 tempest-ServerStableDeviceRescueTest-1642713032 None] attachment_update completed successfully. Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] volume v_05d362e8-1aaf-4bbb-8a9f-9f153920e00c deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.quota [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Created reservations ['0b11c458-476d-4717-b8ce-e5c8cecd5e0e', 'c9f2f151-ba8c-4ccc-bef6-df4f09da4140', '1dc77c62-37ff-41a4-9ba7-e2aec5950a8c', '7215088b-2124-4feb-9798-b96333302e4e'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c599362-8d4e-4d28-80e2-831748f08cdd tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4baed33f-013a-45e2-b4bf-36add0ac5c86/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3c599362-8d4e-4d28-80e2-831748f08cdd tempest-VolumesSnapshotTestJSON-423841644 None] get volume s_4baed33f-013a-45e2-b4bf-36add0ac5c86 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c599362-8d4e-4d28-80e2-831748f08cdd tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4baed33f-013a-45e2-b4bf-36add0ac5c86 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c599362-8d4e-4d28-80e2-831748f08cdd tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4baed33f-013a-45e2-b4bf-36add0ac5c86 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c599362-8d4e-4d28-80e2-831748f08cdd tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_eb69c0bd-af4f-438c-b96a-94c59261813a@s_4baed33f-013a-45e2-b4bf-36add0ac5c86', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_4baed33f-013a-45e2-b4bf-36add0ac5c86', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443317', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113285', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2244090060875307317', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9fdbcffd1a29b855', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275704832', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85983', 'name': 's_4baed33f-013a-45e2-b4bf-36add0ac5c86', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4baed33f-013a-45e2-b4bf-36add0ac5c86 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3c599362-8d4e-4d28-80e2-831748f08cdd tempest-VolumesSnapshotTestJSON-423841644 None] delete snapshot s_4baed33f-013a-45e2-b4bf-36add0ac5c86 of volume v_eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c599362-8d4e-4d28-80e2-831748f08cdd tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots/s_4baed33f-013a-45e2-b4bf-36add0ac5c86 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c599362-8d4e-4d28-80e2-831748f08cdd tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots/s_4baed33f-013a-45e2-b4bf-36add0ac5c86 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Geting {'code': 200, 'error': None, 'data': {'available': '114275704832', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.manager [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:13:59 user cinder-volume[73403]: INFO cinder.volume.manager [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Deleted volume successfully. Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.coordination [None req-778eb6c2-590d-4a42-9c8c-a3925caf4ef1 tempest-ServerRescueNegativeTestJSON-773851452 None] Lock "cinder-05d362e8-1aaf-4bbb-8a9f-9f153920e00c-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.coordination [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Acquiring lock "cinder-c4f0f726-f20c-4b09-89f2-59415d36a8eb-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.coordination [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Lock "cinder-c4f0f726-f20c-4b09-89f2-59415d36a8eb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] remove_export for volume: c4f0f726-f20c-4b09-89f2-59415d36a8eb. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-634681456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c4f0f726-f20c-4b09-89f2-59415d36a8eb,launched_at=2023-04-14T03:02:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='558bfd7e1d9049d396381de148b0c4a5',provider_auth='CHAP IbSuOxfB BSn305VaRbIgpT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4f0f726-f20c-4b09-89f2-59415d36a8eb 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:02:40Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:14:00Z,updated_at=2023-04-14T03:14:00Z,use_quota=True,user_id='d5e8150f1502427fb3148f20354d212e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:c4f0f726-f20c-4b09-89f2-59415d36a8eb. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] detach volume v_c4f0f726-f20c-4b09-89f2-59415d36a8eb from target iqn.2010-10.org.openstack:c4f0f726-f20c-4b09-89f2-59415d36a8eb {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c4f0f726-f20c-4b09-89f2-59415d36a8eb/luns/v_c4f0f726-f20c-4b09-89f2-59415d36a8eb {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c4f0f726-f20c-4b09-89f2-59415d36a8eb/luns/v_c4f0f726-f20c-4b09-89f2-59415d36a8eb {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c4f0f726-f20c-4b09-89f2-59415d36a8eb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c4f0f726-f20c-4b09-89f2-59415d36a8eb/luns/v_c4f0f726-f20c-4b09-89f2-59415d36a8eb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c4f0f726-f20c-4b09-89f2-59415d36a8eb/luns/v_c4f0f726-f20c-4b09-89f2-59415d36a8eb {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] failed to remove resource iqn.2010-10.org.openstack:c4f0f726-f20c-4b09-89f2-59415d36a8eb because of JDSS resource v_c4f0f726-f20c-4b09-89f2-59415d36a8eb DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] delete target: iqn.2010-10.org.openstack:c4f0f726-f20c-4b09-89f2-59415d36a8eb {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] delete target iqn.2010-10.org.openstack:c4f0f726-f20c-4b09-89f2-59415d36a8eb {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c4f0f726-f20c-4b09-89f2-59415d36a8eb {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c4f0f726-f20c-4b09-89f2-59415d36a8eb {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c4f0f726-f20c-4b09-89f2-59415d36a8eb not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c4f0f726-f20c-4b09-89f2-59415d36a8eb'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c4f0f726-f20c-4b09-89f2-59415d36a8eb {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] failed to remove resource iqn.2010-10.org.openstack:c4f0f726-f20c-4b09-89f2-59415d36a8eb because of JDSS resource iqn.2010-10.org.openstack:c4f0f726-f20c-4b09-89f2-59415d36a8eb DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] deleating volume v_c4f0f726-f20c-4b09-89f2-59415d36a8eb {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] get snapshots for volume v_c4f0f726-f20c-4b09-89f2-59415d36a8eb {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c4f0f726-f20c-4b09-89f2-59415d36a8eb/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:13:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c4f0f726-f20c-4b09-89f2-59415d36a8eb/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c4f0f726-f20c-4b09-89f2-59415d36a8eb/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] get volume v_c4f0f726-f20c-4b09-89f2-59415d36a8eb info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:14:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c4f0f726-f20c-4b09-89f2-59415d36a8eb {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c4f0f726-f20c-4b09-89f2-59415d36a8eb {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c4f0f726-f20c-4b09-89f2-59415d36a8eb', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442769', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112868', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9235985024379988313', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4a6d36fa15bc3ef7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275680256', 'san:volume_id': '4a6d36fa15bc3ef72499661c1524950eb05b6159', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84974', 'name': 'v_c4f0f726-f20c-4b09-89f2-59415d36a8eb', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c4f0f726-f20c-4b09-89f2-59415d36a8eb {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] delete volume:v_c4f0f726-f20c-4b09-89f2-59415d36a8eb recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:14:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c4f0f726-f20c-4b09-89f2-59415d36a8eb {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c4f0f726-f20c-4b09-89f2-59415d36a8eb {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3c599362-8d4e-4d28-80e2-831748f08cdd tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots/s_4baed33f-013a-45e2-b4bf-36add0ac5c86 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3c599362-8d4e-4d28-80e2-831748f08cdd tempest-VolumesSnapshotTestJSON-423841644 None] snapshot s_4baed33f-013a-45e2-b4bf-36add0ac5c86 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:14:00 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=65,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=6 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:14:00 user cinder-volume[73403]: DEBUG cinder.quota [None req-3c599362-8d4e-4d28-80e2-831748f08cdd tempest-VolumesSnapshotTestJSON-423841644 None] Created reservations ['351fbb56-afbc-4f10-a928-98ee7c606031', 'b4c64f5a-9006-4bf9-8e73-3be7ab438b21', '7ecafd3a-de19-46ef-9e5c-909840646a6c', 'd954e6f2-bb05-4078-8966-e0f46b00d803'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:14:01 user cinder-volume[73403]: INFO cinder.volume.manager [None req-3c599362-8d4e-4d28-80e2-831748f08cdd tempest-VolumesSnapshotTestJSON-423841644 None] Delete snapshot completed successfully. Apr 14 03:14:01 user cinder-volume[73403]: DEBUG cinder.coordination [None req-3c599362-8d4e-4d28-80e2-831748f08cdd tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-4baed33f-013a-45e2-b4bf-36add0ac5c86-delete_snapshot" released by "delete_snapshot" :: held 2.818s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:14:01 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a76a544a-2e47-4a86-82a7-f633933ce1cb tempest-VolumesSnapshotTestJSON-423841644 None] Acquiring lock "cinder-cbe6d01e-e4fd-4624-9f34-4170f986c3ca-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:14:01 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a76a544a-2e47-4a86-82a7-f633933ce1cb tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-cbe6d01e-e4fd-4624-9f34-4170f986c3ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:14:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a76a544a-2e47-4a86-82a7-f633933ce1cb tempest-VolumesSnapshotTestJSON-423841644 None] deleating snapshot s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:14:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a76a544a-2e47-4a86-82a7-f633933ce1cb tempest-VolumesSnapshotTestJSON-423841644 None] get snapshots for volume s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:14:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76a544a-2e47-4a86-82a7-f633933ce1cb tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76a544a-2e47-4a86-82a7-f633933ce1cb tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c4f0f726-f20c-4b09-89f2-59415d36a8eb {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] volume v_c4f0f726-f20c-4b09-89f2-59415d36a8eb deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:14:02 user cinder-volume[73403]: DEBUG cinder.quota [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Created reservations ['e4633d4c-3d03-4397-b05f-25c7d4fc23bb', '105e7675-a1e9-4d9d-888d-b83572917dd5', 'db360cd6-ecc1-492f-a63b-ecf165bfe8b0', 'ce3352a2-a5ef-4f42-abdd-f85f0d2a1100'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:14:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76a544a-2e47-4a86-82a7-f633933ce1cb tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a76a544a-2e47-4a86-82a7-f633933ce1cb tempest-VolumesSnapshotTestJSON-423841644 None] get volume s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:14:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76a544a-2e47-4a86-82a7-f633933ce1cb tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76a544a-2e47-4a86-82a7-f633933ce1cb tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:14:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:14:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76a544a-2e47-4a86-82a7-f633933ce1cb tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_eb69c0bd-af4f-438c-b96a-94c59261813a@s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443439', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113394', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1959484181433594688', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '351100f3a9107bf3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275823616', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85876', 'name': 's_cbe6d01e-e4fd-4624-9f34-4170f986c3ca', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a76a544a-2e47-4a86-82a7-f633933ce1cb tempest-VolumesSnapshotTestJSON-423841644 None] delete snapshot s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca of volume v_eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:14:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76a544a-2e47-4a86-82a7-f633933ce1cb tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots/s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76a544a-2e47-4a86-82a7-f633933ce1cb tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots/s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:02 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=63,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=7 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:14:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Geting {'code': 200, 'error': None, 'data': {'available': '114275811328', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:14:02 user cinder-volume[73403]: DEBUG cinder.manager [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:14:02 user cinder-volume[73403]: INFO cinder.volume.manager [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Deleted volume successfully. Apr 14 03:14:02 user cinder-volume[73403]: DEBUG cinder.coordination [None req-195142f9-0136-4cc5-a4c9-9b2ffd1c8cbf tempest-ServerRescueNegativeTestJSON-773851452 None] Lock "cinder-c4f0f726-f20c-4b09-89f2-59415d36a8eb-delete_volume" released by "delete_volume" :: held 3.299s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:14:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:14:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:14:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:14:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a76a544a-2e47-4a86-82a7-f633933ce1cb tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots/s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a76a544a-2e47-4a86-82a7-f633933ce1cb tempest-VolumesSnapshotTestJSON-423841644 None] snapshot s_cbe6d01e-e4fd-4624-9f34-4170f986c3ca deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:14:04 user cinder-volume[73403]: DEBUG cinder.quota [None req-a76a544a-2e47-4a86-82a7-f633933ce1cb tempest-VolumesSnapshotTestJSON-423841644 None] Created reservations ['14e0ebaf-4bc6-4ab0-8fa0-0366f1417c21', '8c748839-9d8b-468b-a4b2-ebba3617edca', '2303db2e-6f0f-43be-aaf7-610faf61e7f9', '93984270-3f09-4935-91ed-054c864e4fd2'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:14:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114275835904', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:14:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:14:04 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a76a544a-2e47-4a86-82a7-f633933ce1cb tempest-VolumesSnapshotTestJSON-423841644 None] Delete snapshot completed successfully. Apr 14 03:14:04 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a76a544a-2e47-4a86-82a7-f633933ce1cb tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-cbe6d01e-e4fd-4624-9f34-4170f986c3ca-delete_snapshot" released by "delete_snapshot" :: held 2.725s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:14:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a18ebcfa-8927-4fde-9710-abe0a21f955f req-d9912771-9231-43a7-8c8d-2ff0ca46f983 tempest-VolumesSnapshotTestJSON-423841644 None] terminate connection for eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:14:05 user cinder-volume[73403]: INFO cinder.volume.manager [req-a18ebcfa-8927-4fde-9710-abe0a21f955f req-d9912771-9231-43a7-8c8d-2ff0ca46f983 tempest-VolumesSnapshotTestJSON-423841644 None] Terminate volume connection completed successfully. Apr 14 03:14:05 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-a18ebcfa-8927-4fde-9710-abe0a21f955f req-d9912771-9231-43a7-8c8d-2ff0ca46f983 tempest-VolumesSnapshotTestJSON-423841644 None] Deleting attachment 84b39d34-19fb-4a0d-98ba-939032766d98. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:14:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a18ebcfa-8927-4fde-9710-abe0a21f955f req-d9912771-9231-43a7-8c8d-2ff0ca46f983 tempest-VolumesSnapshotTestJSON-423841644 None] remove_export for volume: eb69c0bd-af4f-438c-b96a-94c59261813a. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:14:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a18ebcfa-8927-4fde-9710-abe0a21f955f req-d9912771-9231-43a7-8c8d-2ff0ca46f983 tempest-VolumesSnapshotTestJSON-423841644 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:14:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a18ebcfa-8927-4fde-9710-abe0a21f955f req-d9912771-9231-43a7-8c8d-2ff0ca46f983 tempest-VolumesSnapshotTestJSON-423841644 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2095910999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=eb69c0bd-af4f-438c-b96a-94c59261813a,launched_at=2023-04-14T03:08:23Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='4549f6080dcf4c739ac03ef643801fbc',provider_auth='CHAP pjXgqBiH dPnr7LhVIsNHbG',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:08:21Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:14:05Z,use_quota=True,user_id='0128a733bd6a4120addba5eda1cc05fb',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:14:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a18ebcfa-8927-4fde-9710-abe0a21f955f req-d9912771-9231-43a7-8c8d-2ff0ca46f983 tempest-VolumesSnapshotTestJSON-423841644 None] detach volume v_eb69c0bd-af4f-438c-b96a-94c59261813a from target iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:14:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a18ebcfa-8927-4fde-9710-abe0a21f955f req-d9912771-9231-43a7-8c8d-2ff0ca46f983 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a/luns/v_eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a18ebcfa-8927-4fde-9710-abe0a21f955f req-d9912771-9231-43a7-8c8d-2ff0ca46f983 tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a/luns/v_eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a18ebcfa-8927-4fde-9710-abe0a21f955f req-d9912771-9231-43a7-8c8d-2ff0ca46f983 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a/luns/v_eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a18ebcfa-8927-4fde-9710-abe0a21f955f req-d9912771-9231-43a7-8c8d-2ff0ca46f983 tempest-VolumesSnapshotTestJSON-423841644 None] delete target: iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:14:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a18ebcfa-8927-4fde-9710-abe0a21f955f req-d9912771-9231-43a7-8c8d-2ff0ca46f983 tempest-VolumesSnapshotTestJSON-423841644 None] delete target iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:14:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a18ebcfa-8927-4fde-9710-abe0a21f955f req-d9912771-9231-43a7-8c8d-2ff0ca46f983 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a18ebcfa-8927-4fde-9710-abe0a21f955f req-d9912771-9231-43a7-8c8d-2ff0ca46f983 tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a18ebcfa-8927-4fde-9710-abe0a21f955f req-d9912771-9231-43a7-8c8d-2ff0ca46f983 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a18ebcfa-8927-4fde-9710-abe0a21f955f req-d9912771-9231-43a7-8c8d-2ff0ca46f983 tempest-VolumesSnapshotTestJSON-423841644 None] target iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Flow 'volume_create_manager' (69c78eb7-4155-461b-8cb1-d0d9d4eb3429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702270e7-f21b-494a-b165-24507805ffc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702270e7-f21b-494a-b165-24507805ffc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1077479502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7378e388-0e78-4212-b0ce-a1e082ba31ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4075885e26cb4adaad24d3ae6217fe35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:14:15Z,use_quota=True,user_id='7dea23743ba945c4a9d539b8e277c653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e063bc62-92e3-48b5-b325-de2045a8110c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e063bc62-92e3-48b5-b325-de2045a8110c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400f4180-c469-4ac4-9fd2-40da94c0b1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400f4180-c469-4ac4-9fd2-40da94c0b1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7378e388-0e78-4212-b0ce-a1e082ba31ab', 'volume_name': 'volume-7378e388-0e78-4212-b0ce-a1e082ba31ab', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d539022b-b218-4ad6-8eae-4bfcb849ab44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d539022b-b218-4ad6-8eae-4bfcb849ab44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ceb539-a8a4-43d1-9052-362414f70048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:14:14 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Volume 7378e388-0e78-4212-b0ce-a1e082ba31ab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7378e388-0e78-4212-b0ce-a1e082ba31ab', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Cloning 7378e388-0e78-4212-b0ce-a1e082ba31ab from image 98e6a247-250b-4bb5-a947-e7f93598d16e at location (None, None). {{(pid=73403) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.coordination [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Acquiring lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" by "_prepare_image_cache_entry" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.coordination [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 3, 14, 14, 826101)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Found cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.coordination [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Attempting to retrieve cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 3, 14, 14, 840393)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Creating from source image-volume 482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] cloned volume 482f938f-083c-4221-99f8-3320a80b8725 to 7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] cloning v_482f938f-083c-4221-99f8-3320a80b8725 to v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] create snapshot v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_7378e388-0e78-4212-b0ce-a1e082ba31ab'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] create volume v_7378e388-0e78-4212-b0ce-a1e082ba31ab from snapshot v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:14:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_7378e388-0e78-4212-b0ce-a1e082ba31ab', 'is_clone': True, 'full_name': 'Pool-0/v_7378e388-0e78-4212-b0ce-a1e082ba31ab', 'name': 'v_7378e388-0e78-4212-b0ce-a1e082ba31ab'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] get volume v_7378e388-0e78-4212-b0ce-a1e082ba31ab info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:14:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_7378e388-0e78-4212-b0ce-a1e082ba31ab', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7378e388-0e78-4212-b0ce-a1e082ba31ab', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443465', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '113430', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2276685035180601728', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '01879db36f93b921', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275811328', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '84734', 'name': 'v_7378e388-0e78-4212-b0ce-a1e082ba31ab', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:16 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Marking volume 7378e388-0e78-4212-b0ce-a1e082ba31ab as bootable. {{(pid=73403) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 03:14:16 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Copying metadata from image 98e6a247-250b-4bb5-a947-e7f93598d16e to 7378e388-0e78-4212-b0ce-a1e082ba31ab. {{(pid=73403) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 03:14:16 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Creating volume glance metadata for volume 7378e388-0e78-4212-b0ce-a1e082ba31ab backed by image 98e6a247-250b-4bb5-a947-e7f93598d16e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73403) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 03:14:16 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ceb539-a8a4-43d1-9052-362414f70048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7378e388-0e78-4212-b0ce-a1e082ba31ab', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:14:16 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7a6ff3-bc25-4a25-9563-f9a526de71ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:14:16 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Volume volume-7378e388-0e78-4212-b0ce-a1e082ba31ab (7378e388-0e78-4212-b0ce-a1e082ba31ab): created successfully Apr 14 03:14:16 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7a6ff3-bc25-4a25-9563-f9a526de71ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:14:16 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Flow 'volume_create_manager' (69c78eb7-4155-461b-8cb1-d0d9d4eb3429) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:14:16 user cinder-volume[73403]: INFO cinder.volume.manager [None req-9ad69e3a-76ce-4d09-9376-20e43f827bb8 tempest-ServerActionsTestJSON-1848627478 None] Created volume successfully. Apr 14 03:14:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] create export for volume: 7378e388-0e78-4212-b0ce-a1e082ba31ab. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:14:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] ensure volume 7378e388-0e78-4212-b0ce-a1e082ba31ab assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:14:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] check if targe iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:14:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] create target and attach volume 7378e388-0e78-4212-b0ce-a1e082ba31ab to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:14:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] create target iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:14:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] atach volume v_7378e388-0e78-4212-b0ce-a1e082ba31ab to target iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:14:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3031383739646233', 'lun': 0, 'mode': 'wt', 'name': 'v_7378e388-0e78-4212-b0ce-a1e082ba31ab', 'prod_id': 'Storage', 'scsi_id': '01879db36f93b921'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] add credentails to target iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:14:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'name': 'tUxPOhHN'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] initialize_connection for 7378e388-0e78-4212-b0ce-a1e082ba31ab 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:14:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUxPOhHN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '237abed3-9ad3-4617-8ee3-b0428e0a2a34'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:14:24 user cinder-volume[73403]: INFO cinder.volume.manager [req-5143b4d4-ae15-4d5c-a126-ae638aefefcb req-76f3bea5-b3a1-45fe-bdaf-4e6e6dfae678 tempest-ServerActionsTestJSON-1848627478 None] attachment_update completed successfully. Apr 14 03:14:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=56,cinder:UPDATE=27,cinder:INSERT=12,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:14:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:DELETE=1,cinder:SELECT=40,cinder:INSERT=7,cinder:UPDATE=13 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:14:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 req-41afa019-6984-4fb5-9804-deb70bf1fb12 tempest-TestVolumeBootPattern-910285030 None] terminate connection for 0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:14:47 user cinder-volume[73403]: INFO cinder.volume.manager [req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 req-41afa019-6984-4fb5-9804-deb70bf1fb12 tempest-TestVolumeBootPattern-910285030 None] Terminate volume connection completed successfully. Apr 14 03:14:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 req-41afa019-6984-4fb5-9804-deb70bf1fb12 tempest-TestVolumeBootPattern-910285030 None] Deleting attachment b02ad57f-7445-460d-9b5a-d11efdcd54d4. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:14:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 req-41afa019-6984-4fb5-9804-deb70bf1fb12 tempest-TestVolumeBootPattern-910285030 None] remove_export for volume: 0ae128f0-64ab-4413-bae2-15cd90212c53. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:14:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 req-41afa019-6984-4fb5-9804-deb70bf1fb12 tempest-TestVolumeBootPattern-910285030 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:14:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 req-41afa019-6984-4fb5-9804-deb70bf1fb12 tempest-TestVolumeBootPattern-910285030 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-1785204424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0ae128f0-64ab-4413-bae2-15cd90212c53,launched_at=2023-04-14T03:12:50Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='2d2e49e8e92e416faebf55e3d4e0e087',provider_auth='CHAP tyovbWPn NQ8AT432BfjnWo',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:12:48Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=ed48619f-2a10-4992-8c6d-6520e0d6f7ba,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:12:58Z,use_quota=True,user_id='60e11b7ab2914209b23bf7a53791da64',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:14:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 req-41afa019-6984-4fb5-9804-deb70bf1fb12 tempest-TestVolumeBootPattern-910285030 None] detach volume v_0ae128f0-64ab-4413-bae2-15cd90212c53 from target iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:14:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 req-41afa019-6984-4fb5-9804-deb70bf1fb12 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53/luns/v_0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 req-41afa019-6984-4fb5-9804-deb70bf1fb12 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53/luns/v_0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 req-41afa019-6984-4fb5-9804-deb70bf1fb12 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53/luns/v_0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 req-41afa019-6984-4fb5-9804-deb70bf1fb12 tempest-TestVolumeBootPattern-910285030 None] delete target: iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:14:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 req-41afa019-6984-4fb5-9804-deb70bf1fb12 tempest-TestVolumeBootPattern-910285030 None] delete target iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:14:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 req-41afa019-6984-4fb5-9804-deb70bf1fb12 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 req-41afa019-6984-4fb5-9804-deb70bf1fb12 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 req-41afa019-6984-4fb5-9804-deb70bf1fb12 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5b56739b-53e5-4b67-ba3d-2d87b65d5e06 req-41afa019-6984-4fb5-9804-deb70bf1fb12 tempest-TestVolumeBootPattern-910285030 None] target iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:14:55 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:14:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Flow 'volume_create_manager' (70a8e37c-9e25-46ff-9744-bb4986e1e8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:14:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c800362a-047c-4558-a6aa-20a9ec556763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:14:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c800362a-047c-4558-a6aa-20a9ec556763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1781611910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ecae2af8-2c36-488d-86ea-b99152ffb9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4549f6080dcf4c739ac03ef643801fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:14:56Z,use_quota=True,user_id='0128a733bd6a4120addba5eda1cc05fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:14:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c55f64-d0f0-4ba6-be37-1b101f9b16f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:14:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c55f64-d0f0-4ba6-be37-1b101f9b16f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:14:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86eeabaa-4745-46a8-a128-6f664bc6eb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:14:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86eeabaa-4745-46a8-a128-6f664bc6eb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecae2af8-2c36-488d-86ea-b99152ffb9a2', 'volume_name': 'volume-ecae2af8-2c36-488d-86ea-b99152ffb9a2', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:14:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33216c27-be47-4e35-8883-d36893427b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:14:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33216c27-be47-4e35-8883-d36893427b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:14:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79a061e7-aa91-4610-9528-f8a3f64d1d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:14:55 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Volume ecae2af8-2c36-488d-86ea-b99152ffb9a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecae2af8-2c36-488d-86ea-b99152ffb9a2', 'volume_size': 1} Apr 14 03:14:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] creating volume v_ecae2af8-2c36-488d-86ea-b99152ffb9a2. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:14:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] create volume {'name': 'v_ecae2af8-2c36-488d-86ea-b99152ffb9a2', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:14:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2', 'is_clone': False, 'name': 'v_ecae2af8-2c36-488d-86ea-b99152ffb9a2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79a061e7-aa91-4610-9528-f8a3f64d1d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecae2af8-2c36-488d-86ea-b99152ffb9a2', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:14:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176247c2-59ae-4f85-8c2e-bbdb76ee233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:14:56 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Volume volume-ecae2af8-2c36-488d-86ea-b99152ffb9a2 (ecae2af8-2c36-488d-86ea-b99152ffb9a2): created successfully Apr 14 03:14:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176247c2-59ae-4f85-8c2e-bbdb76ee233e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:14:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Flow 'volume_create_manager' (70a8e37c-9e25-46ff-9744-bb4986e1e8a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:14:56 user cinder-volume[73403]: INFO cinder.volume.manager [None req-f2bab59a-ac8b-4c42-a9b9-f0d54b05b980 tempest-VolumesSnapshotTestJSON-423841644 None] Created volume successfully. Apr 14 03:14:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84c69475-1751-4a21-b7dd-9e98627b02d9 tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot de252c97-84b3-4e29-9d67-e4baaa410f51 for volume ecae2af8-2c36-488d-86ea-b99152ffb9a2 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:14:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84c69475-1751-4a21-b7dd-9e98627b02d9 tempest-VolumesSnapshotTestJSON-423841644 None] cloning v_ecae2af8-2c36-488d-86ea-b99152ffb9a2 to s_de252c97-84b3-4e29-9d67-e4baaa410f51 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:14:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84c69475-1751-4a21-b7dd-9e98627b02d9 tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot s_de252c97-84b3-4e29-9d67-e4baaa410f51 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:14:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84c69475-1751-4a21-b7dd-9e98627b02d9 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84c69475-1751-4a21-b7dd-9e98627b02d9 tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:58 user cinder-volume[73403]: DEBUG cinder.coordination [None req-bfced1d2-d3d6-47e8-94d6-efd863e74fdb tempest-VolumesActionsTest-121883605 None] Acquiring lock "cinder-117adce3-717a-4664-8cfa-be7d1f5d0169" by "attach_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:14:58 user cinder-volume[73403]: DEBUG cinder.coordination [None req-bfced1d2-d3d6-47e8-94d6-efd863e74fdb tempest-VolumesActionsTest-121883605 None] Lock "cinder-117adce3-717a-4664-8cfa-be7d1f5d0169" acquired by "attach_volume" :: waited 0.011s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:14:58 user cinder-volume[73403]: INFO cinder.volume.manager [None req-bfced1d2-d3d6-47e8-94d6-efd863e74fdb tempest-VolumesActionsTest-121883605 None] Attaching volume 117adce3-717a-4664-8cfa-be7d1f5d0169 to instance d309dc50-d3b0-47a4-b263-a67ae96e2f5b at mountpoint /dev/vdb on host None. Apr 14 03:14:58 user cinder-volume[73403]: INFO cinder.volume.manager [None req-bfced1d2-d3d6-47e8-94d6-efd863e74fdb tempest-VolumesActionsTest-121883605 None] Attach volume completed successfully. Apr 14 03:14:58 user cinder-volume[73403]: DEBUG cinder.coordination [None req-bfced1d2-d3d6-47e8-94d6-efd863e74fdb tempest-VolumesActionsTest-121883605 None] Lock "cinder-117adce3-717a-4664-8cfa-be7d1f5d0169" released by "attach_volume" :: held 0.061s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:14:58 user cinder-volume[73403]: DEBUG cinder.coordination [None req-9e2c5d57-1064-45b8-b66c-31f932e0219d tempest-VolumesActionsTest-121883605 None] Acquiring lock "cinder-117adce3-717a-4664-8cfa-be7d1f5d0169-detach_volume" by "detach_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:14:58 user cinder-volume[73403]: DEBUG cinder.coordination [None req-9e2c5d57-1064-45b8-b66c-31f932e0219d tempest-VolumesActionsTest-121883605 None] Lock "cinder-117adce3-717a-4664-8cfa-be7d1f5d0169-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:14:58 user cinder-volume[73403]: INFO cinder.volume.manager [None req-9e2c5d57-1064-45b8-b66c-31f932e0219d tempest-VolumesActionsTest-121883605 None] Detaching volume 117adce3-717a-4664-8cfa-be7d1f5d0169 from instance d309dc50-d3b0-47a4-b263-a67ae96e2f5b. Apr 14 03:14:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e2c5d57-1064-45b8-b66c-31f932e0219d tempest-VolumesActionsTest-121883605 None] remove_export for volume: 117adce3-717a-4664-8cfa-be7d1f5d0169. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:14:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e2c5d57-1064-45b8-b66c-31f932e0219d tempest-VolumesActionsTest-121883605 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:14:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e2c5d57-1064-45b8-b66c-31f932e0219d tempest-VolumesActionsTest-121883605 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-569973521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=117adce3-717a-4664-8cfa-be7d1f5d0169,launched_at=2023-04-14T03:10:24Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1318728a20064d49b9c1b2f89175a364',provider_auth='CHAP jOXbqBQa yUTrKfO7vhBHQz',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:10:23Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:14:59Z,use_quota=True,user_id='b2facbf385e8402c86706cc28d4707af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:14:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e2c5d57-1064-45b8-b66c-31f932e0219d tempest-VolumesActionsTest-121883605 None] detach volume v_117adce3-717a-4664-8cfa-be7d1f5d0169 from target iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:14:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e2c5d57-1064-45b8-b66c-31f932e0219d tempest-VolumesActionsTest-121883605 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/luns/v_117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e2c5d57-1064-45b8-b66c-31f932e0219d tempest-VolumesActionsTest-121883605 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/luns/v_117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84c69475-1751-4a21-b7dd-9e98627b02d9 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_de252c97-84b3-4e29-9d67-e4baaa410f51'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84c69475-1751-4a21-b7dd-9e98627b02d9 tempest-VolumesSnapshotTestJSON-423841644 None] create volume s_de252c97-84b3-4e29-9d67-e4baaa410f51 from snapshot s_de252c97-84b3-4e29-9d67-e4baaa410f51 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:14:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84c69475-1751-4a21-b7dd-9e98627b02d9 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84c69475-1751-4a21-b7dd-9e98627b02d9 tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e2c5d57-1064-45b8-b66c-31f932e0219d tempest-VolumesActionsTest-121883605 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/luns/v_117adce3-717a-4664-8cfa-be7d1f5d0169'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/luns/v_117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e2c5d57-1064-45b8-b66c-31f932e0219d tempest-VolumesActionsTest-121883605 None] failed to remove resource iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 because of JDSS resource v_117adce3-717a-4664-8cfa-be7d1f5d0169 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:14:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e2c5d57-1064-45b8-b66c-31f932e0219d tempest-VolumesActionsTest-121883605 None] delete target: iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:14:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e2c5d57-1064-45b8-b66c-31f932e0219d tempest-VolumesActionsTest-121883605 None] delete target iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:14:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e2c5d57-1064-45b8-b66c-31f932e0219d tempest-VolumesActionsTest-121883605 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e2c5d57-1064-45b8-b66c-31f932e0219d tempest-VolumesActionsTest-121883605 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e2c5d57-1064-45b8-b66c-31f932e0219d tempest-VolumesActionsTest-121883605 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e2c5d57-1064-45b8-b66c-31f932e0219d tempest-VolumesActionsTest-121883605 None] failed to remove resource iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 because of JDSS resource iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:14:59 user cinder-volume[73403]: INFO cinder.volume.manager [None req-9e2c5d57-1064-45b8-b66c-31f932e0219d tempest-VolumesActionsTest-121883605 None] Detach volume completed successfully. Apr 14 03:14:59 user cinder-volume[73403]: DEBUG cinder.coordination [None req-9e2c5d57-1064-45b8-b66c-31f932e0219d tempest-VolumesActionsTest-121883605 None] Lock "cinder-117adce3-717a-4664-8cfa-be7d1f5d0169-detach_volume" released by "detach_volume" :: held 0.113s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:14:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84c69475-1751-4a21-b7dd-9e98627b02d9 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2@s_de252c97-84b3-4e29-9d67-e4baaa410f51', 'is_clone': True, 'full_name': 'Pool-0/s_de252c97-84b3-4e29-9d67-e4baaa410f51', 'name': 's_de252c97-84b3-4e29-9d67-e4baaa410f51'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84c69475-1751-4a21-b7dd-9e98627b02d9 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de252c97-84b3-4e29-9d67-e4baaa410f51/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:14:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84c69475-1751-4a21-b7dd-9e98627b02d9 tempest-VolumesSnapshotTestJSON-423841644 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de252c97-84b3-4e29-9d67-e4baaa410f51/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:14:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84c69475-1751-4a21-b7dd-9e98627b02d9 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de252c97-84b3-4e29-9d67-e4baaa410f51/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:14:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84c69475-1751-4a21-b7dd-9e98627b02d9 tempest-VolumesSnapshotTestJSON-423841644 None] volume s_de252c97-84b3-4e29-9d67-e4baaa410f51 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:15:00 user cinder-volume[73403]: INFO cinder.volume.manager [None req-84c69475-1751-4a21-b7dd-9e98627b02d9 tempest-VolumesSnapshotTestJSON-423841644 None] Create snapshot completed successfully Apr 14 03:15:00 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:15:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Flow 'volume_create_manager' (4f66c16e-2cde-4fda-807a-a2fc1230218f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:15:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bcb26e7-8f72-4d07-b147-9f26f9a451d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bcb26e7-8f72-4d07-b147-9f26f9a451d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2042931876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8d647498-6a99-49ba-90aa-a5f34e49a86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4549f6080dcf4c739ac03ef643801fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=de252c97-84b3-4e29-9d67-e4baaa410f51,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:15:00Z,use_quota=True,user_id='0128a733bd6a4120addba5eda1cc05fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316e28a5-fbcf-4e41-ac58-1b841dadc105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316e28a5-fbcf-4e41-ac58-1b841dadc105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a4a703-45a7-4d50-94c1-4a143abb77a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a4a703-45a7-4d50-94c1-4a143abb77a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8d647498-6a99-49ba-90aa-a5f34e49a86f', 'volume_name': 'volume-8d647498-6a99-49ba-90aa-a5f34e49a86f', 'volume_size': 2, 'snapshot_id': 'de252c97-84b3-4e29-9d67-e4baaa410f51'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfcdf369-934d-41e9-8d24-dd181d84d2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfcdf369-934d-41e9-8d24-dd181d84d2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:00 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559f7084-35f9-4ff3-8967-455d49828102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:00 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Volume 8d647498-6a99-49ba-90aa-a5f34e49a86f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8d647498-6a99-49ba-90aa-a5f34e49a86f', 'volume_size': 2, 'snapshot_id': 'de252c97-84b3-4e29-9d67-e4baaa410f51'} Apr 14 03:15:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] create volume 8d647498-6a99-49ba-90aa-a5f34e49a86f from snapshot de252c97-84b3-4e29-9d67-e4baaa410f51 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 03:15:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] cloning s_de252c97-84b3-4e29-9d67-e4baaa410f51 to v_8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:15:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot v_8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:15:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de252c97-84b3-4e29-9d67-e4baaa410f51/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de252c97-84b3-4e29-9d67-e4baaa410f51/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_8d647498-6a99-49ba-90aa-a5f34e49a86f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de252c97-84b3-4e29-9d67-e4baaa410f51/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] create volume v_8d647498-6a99-49ba-90aa-a5f34e49a86f from snapshot v_8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:15:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de252c97-84b3-4e29-9d67-e4baaa410f51/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de252c97-84b3-4e29-9d67-e4baaa410f51/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_de252c97-84b3-4e29-9d67-e4baaa410f51@v_8d647498-6a99-49ba-90aa-a5f34e49a86f', 'is_clone': True, 'full_name': 'Pool-0/v_8d647498-6a99-49ba-90aa-a5f34e49a86f', 'name': 'v_8d647498-6a99-49ba-90aa-a5f34e49a86f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de252c97-84b3-4e29-9d67-e4baaa410f51/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] get volume v_8d647498-6a99-49ba-90aa-a5f34e49a86f info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:15:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_de252c97-84b3-4e29-9d67-e4baaa410f51@v_8d647498-6a99-49ba-90aa-a5f34e49a86f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8d647498-6a99-49ba-90aa-a5f34e49a86f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443511', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113461', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9538370668735951406', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7b728df0b78242a6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265522176', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86309', 'name': 'v_8d647498-6a99-49ba-90aa-a5f34e49a86f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Extend volume 8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}} Apr 14 03:15:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] jdss extend volume v_8d647498-6a99-49ba-90aa-a5f34e49a86f to 2147483648 {{(pid=73403) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}} Apr 14 03:15:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:02 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=31,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:15:02 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=8,cinder:SELECT=29,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:15:02 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559f7084-35f9-4ff3-8967-455d49828102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d647498-6a99-49ba-90aa-a5f34e49a86f', 'volume_size': 2, 'snapshot_id': 'de252c97-84b3-4e29-9d67-e4baaa410f51'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:02 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c510c3c0-c97f-4d05-814f-c6f87d4ab954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:02 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Volume volume-8d647498-6a99-49ba-90aa-a5f34e49a86f (8d647498-6a99-49ba-90aa-a5f34e49a86f): created successfully Apr 14 03:15:02 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c510c3c0-c97f-4d05-814f-c6f87d4ab954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:02 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Flow 'volume_create_manager' (4f66c16e-2cde-4fda-807a-a2fc1230218f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:15:02 user cinder-volume[73403]: INFO cinder.volume.manager [None req-ac48e794-554d-4f9f-89c0-aa9cd3be45b2 tempest-VolumesSnapshotTestJSON-423841644 None] Created volume successfully. Apr 14 03:15:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.coordination [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Acquiring lock "cinder-8d647498-6a99-49ba-90aa-a5f34e49a86f-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.coordination [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-8d647498-6a99-49ba-90aa-a5f34e49a86f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] remove_export for volume: 8d647498-6a99-49ba-90aa-a5f34e49a86f. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2042931876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8d647498-6a99-49ba-90aa-a5f34e49a86f,launched_at=2023-04-14T03:15:03Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4549f6080dcf4c739ac03ef643801fbc',provider_auth='CHAP jthksBER jbSRatHecIiE5u',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d647498-6a99-49ba-90aa-a5f34e49a86f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:00Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=2,snapshot_id=de252c97-84b3-4e29-9d67-e4baaa410f51,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:15:04Z,updated_at=2023-04-14T03:15:04Z,use_quota=True,user_id='0128a733bd6a4120addba5eda1cc05fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:8d647498-6a99-49ba-90aa-a5f34e49a86f. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] detach volume v_8d647498-6a99-49ba-90aa-a5f34e49a86f from target iqn.2010-10.org.openstack:8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8d647498-6a99-49ba-90aa-a5f34e49a86f/luns/v_8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8d647498-6a99-49ba-90aa-a5f34e49a86f/luns/v_8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8d647498-6a99-49ba-90aa-a5f34e49a86f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8d647498-6a99-49ba-90aa-a5f34e49a86f/luns/v_8d647498-6a99-49ba-90aa-a5f34e49a86f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8d647498-6a99-49ba-90aa-a5f34e49a86f/luns/v_8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] failed to remove resource iqn.2010-10.org.openstack:8d647498-6a99-49ba-90aa-a5f34e49a86f because of JDSS resource v_8d647498-6a99-49ba-90aa-a5f34e49a86f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] delete target: iqn.2010-10.org.openstack:8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] delete target iqn.2010-10.org.openstack:8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8d647498-6a99-49ba-90aa-a5f34e49a86f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8d647498-6a99-49ba-90aa-a5f34e49a86f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] failed to remove resource iqn.2010-10.org.openstack:8d647498-6a99-49ba-90aa-a5f34e49a86f because of JDSS resource iqn.2010-10.org.openstack:8d647498-6a99-49ba-90aa-a5f34e49a86f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] deleating volume v_8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] get snapshots for volume v_8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d647498-6a99-49ba-90aa-a5f34e49a86f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d647498-6a99-49ba-90aa-a5f34e49a86f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114265440256', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:15:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:15:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d647498-6a99-49ba-90aa-a5f34e49a86f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] get volume v_8d647498-6a99-49ba-90aa-a5f34e49a86f info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:15:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_de252c97-84b3-4e29-9d67-e4baaa410f51@v_8d647498-6a99-49ba-90aa-a5f34e49a86f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8d647498-6a99-49ba-90aa-a5f34e49a86f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443511', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113461', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9538370668735951406', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7b728df0b78242a6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265440256', 'san:volume_id': '7b728df0b78242a65e55a2ab060ee26b68a713a0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86309', 'name': 'v_8d647498-6a99-49ba-90aa-a5f34e49a86f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] delete snapshot v_8d647498-6a99-49ba-90aa-a5f34e49a86f of volume s_de252c97-84b3-4e29-9d67-e4baaa410f51 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:15:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de252c97-84b3-4e29-9d67-e4baaa410f51/snapshots/v_8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de252c97-84b3-4e29-9d67-e4baaa410f51/snapshots/v_8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de252c97-84b3-4e29-9d67-e4baaa410f51/snapshots/v_8d647498-6a99-49ba-90aa-a5f34e49a86f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] snapshot v_8d647498-6a99-49ba-90aa-a5f34e49a86f deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:15:05 user cinder-volume[73403]: DEBUG cinder.quota [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Created reservations ['4e868410-1fda-4e0e-b0e3-f6ded9511e85', '87d2143b-5199-43d0-9ebf-8853a5716ed8', 'a44cb351-6350-4d0c-a5b1-3729e638035a', '2769e5a6-d313-481a-bd87-433d8453ac69'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:15:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:15:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:15:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'available': '114265522176', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:15:06 user cinder-volume[73403]: DEBUG cinder.manager [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:15:06 user cinder-volume[73403]: INFO cinder.volume.manager [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Deleted volume successfully. Apr 14 03:15:06 user cinder-volume[73403]: DEBUG cinder.coordination [None req-d89c4ce4-e34a-42be-b019-33a781cf1154 tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-8d647498-6a99-49ba-90aa-a5f34e49a86f-delete_volume" released by "delete_volume" :: held 2.790s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:15:07 user cinder-volume[73403]: DEBUG cinder.coordination [None req-404c927b-2a58-43e4-b513-0c0a8dbaf77e tempest-VolumesSnapshotTestJSON-423841644 None] Acquiring lock "cinder-de252c97-84b3-4e29-9d67-e4baaa410f51-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:15:07 user cinder-volume[73403]: DEBUG cinder.coordination [None req-404c927b-2a58-43e4-b513-0c0a8dbaf77e tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-de252c97-84b3-4e29-9d67-e4baaa410f51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:15:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-404c927b-2a58-43e4-b513-0c0a8dbaf77e tempest-VolumesSnapshotTestJSON-423841644 None] deleating snapshot s_de252c97-84b3-4e29-9d67-e4baaa410f51. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:15:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-404c927b-2a58-43e4-b513-0c0a8dbaf77e tempest-VolumesSnapshotTestJSON-423841644 None] get snapshots for volume s_de252c97-84b3-4e29-9d67-e4baaa410f51 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:15:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-404c927b-2a58-43e4-b513-0c0a8dbaf77e tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de252c97-84b3-4e29-9d67-e4baaa410f51/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-404c927b-2a58-43e4-b513-0c0a8dbaf77e tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de252c97-84b3-4e29-9d67-e4baaa410f51/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-404c927b-2a58-43e4-b513-0c0a8dbaf77e tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de252c97-84b3-4e29-9d67-e4baaa410f51/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-404c927b-2a58-43e4-b513-0c0a8dbaf77e tempest-VolumesSnapshotTestJSON-423841644 None] get volume s_de252c97-84b3-4e29-9d67-e4baaa410f51 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:15:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-404c927b-2a58-43e4-b513-0c0a8dbaf77e tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de252c97-84b3-4e29-9d67-e4baaa410f51 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-404c927b-2a58-43e4-b513-0c0a8dbaf77e tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de252c97-84b3-4e29-9d67-e4baaa410f51 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-404c927b-2a58-43e4-b513-0c0a8dbaf77e tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2@s_de252c97-84b3-4e29-9d67-e4baaa410f51', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_de252c97-84b3-4e29-9d67-e4baaa410f51', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443508', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113455', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1929791580445271334', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f8363358efc036bf', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265522176', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86293', 'name': 's_de252c97-84b3-4e29-9d67-e4baaa410f51', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de252c97-84b3-4e29-9d67-e4baaa410f51 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-404c927b-2a58-43e4-b513-0c0a8dbaf77e tempest-VolumesSnapshotTestJSON-423841644 None] delete snapshot s_de252c97-84b3-4e29-9d67-e4baaa410f51 of volume v_ecae2af8-2c36-488d-86ea-b99152ffb9a2 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:15:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-404c927b-2a58-43e4-b513-0c0a8dbaf77e tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2/snapshots/s_de252c97-84b3-4e29-9d67-e4baaa410f51 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-404c927b-2a58-43e4-b513-0c0a8dbaf77e tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2/snapshots/s_de252c97-84b3-4e29-9d67-e4baaa410f51 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-404c927b-2a58-43e4-b513-0c0a8dbaf77e tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2/snapshots/s_de252c97-84b3-4e29-9d67-e4baaa410f51 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-404c927b-2a58-43e4-b513-0c0a8dbaf77e tempest-VolumesSnapshotTestJSON-423841644 None] snapshot s_de252c97-84b3-4e29-9d67-e4baaa410f51 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:15:09 user cinder-volume[73403]: DEBUG cinder.quota [None req-404c927b-2a58-43e4-b513-0c0a8dbaf77e tempest-VolumesSnapshotTestJSON-423841644 None] Created reservations ['135aa867-06c9-45f2-b0d4-ba9824b393c3', 'd5edd349-e227-4008-a21b-c701e86c6d7c', 'e078c6b6-fd51-44f5-8c4f-15b4b3fda143', '4c2c69d4-9c5c-461d-95e7-f54023bf3fa1'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:15:09 user cinder-volume[73403]: INFO cinder.volume.manager [None req-404c927b-2a58-43e4-b513-0c0a8dbaf77e tempest-VolumesSnapshotTestJSON-423841644 None] Delete snapshot completed successfully. Apr 14 03:15:09 user cinder-volume[73403]: DEBUG cinder.coordination [None req-404c927b-2a58-43e4-b513-0c0a8dbaf77e tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-de252c97-84b3-4e29-9d67-e4baaa410f51-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Acquiring lock "cinder-ecae2af8-2c36-488d-86ea-b99152ffb9a2-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-ecae2af8-2c36-488d-86ea-b99152ffb9a2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] remove_export for volume: ecae2af8-2c36-488d-86ea-b99152ffb9a2. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1781611910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ecae2af8-2c36-488d-86ea-b99152ffb9a2,launched_at=2023-04-14T03:14:57Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4549f6080dcf4c739ac03ef643801fbc',provider_auth='CHAP LmvKhTzo 1d0vMlhsVN5m8a',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecae2af8-2c36-488d-86ea-b99152ffb9a2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:14:56Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:15:10Z,updated_at=2023-04-14T03:15:10Z,use_quota=True,user_id='0128a733bd6a4120addba5eda1cc05fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:ecae2af8-2c36-488d-86ea-b99152ffb9a2. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] detach volume v_ecae2af8-2c36-488d-86ea-b99152ffb9a2 from target iqn.2010-10.org.openstack:ecae2af8-2c36-488d-86ea-b99152ffb9a2 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ecae2af8-2c36-488d-86ea-b99152ffb9a2/luns/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ecae2af8-2c36-488d-86ea-b99152ffb9a2/luns/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ecae2af8-2c36-488d-86ea-b99152ffb9a2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ecae2af8-2c36-488d-86ea-b99152ffb9a2/luns/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ecae2af8-2c36-488d-86ea-b99152ffb9a2/luns/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] failed to remove resource iqn.2010-10.org.openstack:ecae2af8-2c36-488d-86ea-b99152ffb9a2 because of JDSS resource v_ecae2af8-2c36-488d-86ea-b99152ffb9a2 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] delete target: iqn.2010-10.org.openstack:ecae2af8-2c36-488d-86ea-b99152ffb9a2 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] delete target iqn.2010-10.org.openstack:ecae2af8-2c36-488d-86ea-b99152ffb9a2 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ecae2af8-2c36-488d-86ea-b99152ffb9a2 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ecae2af8-2c36-488d-86ea-b99152ffb9a2 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ecae2af8-2c36-488d-86ea-b99152ffb9a2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ecae2af8-2c36-488d-86ea-b99152ffb9a2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ecae2af8-2c36-488d-86ea-b99152ffb9a2 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] failed to remove resource iqn.2010-10.org.openstack:ecae2af8-2c36-488d-86ea-b99152ffb9a2 because of JDSS resource iqn.2010-10.org.openstack:ecae2af8-2c36-488d-86ea-b99152ffb9a2 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] deleating volume v_ecae2af8-2c36-488d-86ea-b99152ffb9a2 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] get snapshots for volume v_ecae2af8-2c36-488d-86ea-b99152ffb9a2 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] get volume v_ecae2af8-2c36-488d-86ea-b99152ffb9a2 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443505', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113449', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7071821841986509401', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e9898ca29b93cb99', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265534464', 'san:volume_id': 'e9898ca29b93cb992047fcac0b3743a14d2153eb', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86280', 'name': 'v_ecae2af8-2c36-488d-86ea-b99152ffb9a2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] delete volume:v_ecae2af8-2c36-488d-86ea-b99152ffb9a2 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ecae2af8-2c36-488d-86ea-b99152ffb9a2 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] volume v_ecae2af8-2c36-488d-86ea-b99152ffb9a2 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:15:12 user cinder-volume[73403]: DEBUG cinder.quota [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Created reservations ['77d42b18-ba43-4047-badf-6a5ba84e966c', 'adc5c08e-31fd-4108-bc7b-36e01d9afe17', 'c7ac89c1-7b43-4073-8c70-cdb249cf313f', '60ee7f02-7caf-4d0c-8bb5-18842fd62eaa'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:15:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:15:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:15:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'available': '114265628672', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:15:13 user cinder-volume[73403]: DEBUG cinder.manager [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:15:13 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Deleted volume successfully. Apr 14 03:15:13 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a5946f74-1a28-4783-91c5-b20439c246ff tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-ecae2af8-2c36-488d-86ea-b99152ffb9a2-delete_volume" released by "delete_volume" :: held 3.205s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:15:13 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:15:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Flow 'volume_create_manager' (78695a1b-8605-4a6b-a790-e79b34ba3b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:15:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c99abe6-e3ec-4f0f-abce-8f53ab3df875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c99abe6-e3ec-4f0f-abce-8f53ab3df875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1112270743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d182efd3-7620-422e-a0c2-ecc0d77851f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4549f6080dcf4c739ac03ef643801fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:15:14Z,use_quota=True,user_id='0128a733bd6a4120addba5eda1cc05fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dbff40d-1312-4ce8-9669-1cc930f5086a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dbff40d-1312-4ce8-9669-1cc930f5086a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21a9dc1-3553-4e0e-a542-b7c157906f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21a9dc1-3553-4e0e-a542-b7c157906f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd182efd3-7620-422e-a0c2-ecc0d77851f1', 'volume_name': 'volume-d182efd3-7620-422e-a0c2-ecc0d77851f1', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25fc3c5c-201c-473e-a79d-fe82192ab993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25fc3c5c-201c-473e-a79d-fe82192ab993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f388909-60d1-4f9b-baa0-0a7e756ee3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:13 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Volume d182efd3-7620-422e-a0c2-ecc0d77851f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d182efd3-7620-422e-a0c2-ecc0d77851f1', 'volume_size': 1} Apr 14 03:15:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] creating volume v_d182efd3-7620-422e-a0c2-ecc0d77851f1. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:15:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] create volume {'name': 'v_d182efd3-7620-422e-a0c2-ecc0d77851f1', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:15:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d182efd3-7620-422e-a0c2-ecc0d77851f1', 'is_clone': False, 'name': 'v_d182efd3-7620-422e-a0c2-ecc0d77851f1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f388909-60d1-4f9b-baa0-0a7e756ee3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d182efd3-7620-422e-a0c2-ecc0d77851f1', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbaecc98-c83f-4462-8dab-ad542f595b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:14 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Volume volume-d182efd3-7620-422e-a0c2-ecc0d77851f1 (d182efd3-7620-422e-a0c2-ecc0d77851f1): created successfully Apr 14 03:15:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbaecc98-c83f-4462-8dab-ad542f595b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Flow 'volume_create_manager' (78695a1b-8605-4a6b-a790-e79b34ba3b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:15:14 user cinder-volume[73403]: INFO cinder.volume.manager [None req-5c0c6a6c-65f7-4817-a618-4e59a279b2b1 tempest-VolumesSnapshotTestJSON-423841644 None] Created volume successfully. Apr 14 03:15:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70a3ee27-6908-4339-b0fe-9b2074e16189 tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot d008e95b-53f5-4f90-bf37-3600faa6db7b for volume d182efd3-7620-422e-a0c2-ecc0d77851f1 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:15:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-70a3ee27-6908-4339-b0fe-9b2074e16189 tempest-VolumesSnapshotTestJSON-423841644 None] cloning v_d182efd3-7620-422e-a0c2-ecc0d77851f1 to s_d008e95b-53f5-4f90-bf37-3600faa6db7b {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:15:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70a3ee27-6908-4339-b0fe-9b2074e16189 tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot s_d008e95b-53f5-4f90-bf37-3600faa6db7b {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:15:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a3ee27-6908-4339-b0fe-9b2074e16189 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d182efd3-7620-422e-a0c2-ecc0d77851f1/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a3ee27-6908-4339-b0fe-9b2074e16189 tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d182efd3-7620-422e-a0c2-ecc0d77851f1/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a3ee27-6908-4339-b0fe-9b2074e16189 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_d008e95b-53f5-4f90-bf37-3600faa6db7b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d182efd3-7620-422e-a0c2-ecc0d77851f1/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70a3ee27-6908-4339-b0fe-9b2074e16189 tempest-VolumesSnapshotTestJSON-423841644 None] create volume s_d008e95b-53f5-4f90-bf37-3600faa6db7b from snapshot s_d008e95b-53f5-4f90-bf37-3600faa6db7b {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:15:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a3ee27-6908-4339-b0fe-9b2074e16189 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d182efd3-7620-422e-a0c2-ecc0d77851f1/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a3ee27-6908-4339-b0fe-9b2074e16189 tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d182efd3-7620-422e-a0c2-ecc0d77851f1/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a3ee27-6908-4339-b0fe-9b2074e16189 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d182efd3-7620-422e-a0c2-ecc0d77851f1@s_d008e95b-53f5-4f90-bf37-3600faa6db7b', 'is_clone': True, 'full_name': 'Pool-0/s_d008e95b-53f5-4f90-bf37-3600faa6db7b', 'name': 's_d008e95b-53f5-4f90-bf37-3600faa6db7b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d182efd3-7620-422e-a0c2-ecc0d77851f1/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a3ee27-6908-4339-b0fe-9b2074e16189 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d008e95b-53f5-4f90-bf37-3600faa6db7b/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a3ee27-6908-4339-b0fe-9b2074e16189 tempest-VolumesSnapshotTestJSON-423841644 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d008e95b-53f5-4f90-bf37-3600faa6db7b/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-70a3ee27-6908-4339-b0fe-9b2074e16189 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d008e95b-53f5-4f90-bf37-3600faa6db7b/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-70a3ee27-6908-4339-b0fe-9b2074e16189 tempest-VolumesSnapshotTestJSON-423841644 None] volume s_d008e95b-53f5-4f90-bf37-3600faa6db7b properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:15:16 user cinder-volume[73403]: INFO cinder.volume.manager [None req-70a3ee27-6908-4339-b0fe-9b2074e16189 tempest-VolumesSnapshotTestJSON-423841644 None] Create snapshot completed successfully Apr 14 03:15:17 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:15:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Flow 'volume_create_manager' (22dd167a-9a04-4b4b-8352-a500ad00421f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:15:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55095bf3-31f7-4acd-a868-ef582802832c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55095bf3-31f7-4acd-a868-ef582802832c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-480070847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1fe09443-bbf4-4c23-90a8-511805f53b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4549f6080dcf4c739ac03ef643801fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d008e95b-53f5-4f90-bf37-3600faa6db7b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:15:17Z,use_quota=True,user_id='0128a733bd6a4120addba5eda1cc05fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3882c5-34d5-41d4-be50-d6fa4927dabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3882c5-34d5-41d4-be50-d6fa4927dabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (592f3fdc-aba1-4e20-86a0-95439c57bdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (592f3fdc-aba1-4e20-86a0-95439c57bdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1fe09443-bbf4-4c23-90a8-511805f53b1e', 'volume_name': 'volume-1fe09443-bbf4-4c23-90a8-511805f53b1e', 'volume_size': 1, 'snapshot_id': 'd008e95b-53f5-4f90-bf37-3600faa6db7b'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0be427-27e6-44d9-819c-d7f080521b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0be427-27e6-44d9-819c-d7f080521b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1889ba94-8e2b-4fef-a308-89cf69e75efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:17 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Volume 1fe09443-bbf4-4c23-90a8-511805f53b1e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1fe09443-bbf4-4c23-90a8-511805f53b1e', 'volume_size': 1, 'snapshot_id': 'd008e95b-53f5-4f90-bf37-3600faa6db7b'} Apr 14 03:15:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] create volume 1fe09443-bbf4-4c23-90a8-511805f53b1e from snapshot d008e95b-53f5-4f90-bf37-3600faa6db7b {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 03:15:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] cloning s_d008e95b-53f5-4f90-bf37-3600faa6db7b to v_1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:15:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] create snapshot v_1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:15:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d008e95b-53f5-4f90-bf37-3600faa6db7b/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d008e95b-53f5-4f90-bf37-3600faa6db7b/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_1fe09443-bbf4-4c23-90a8-511805f53b1e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d008e95b-53f5-4f90-bf37-3600faa6db7b/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] create volume v_1fe09443-bbf4-4c23-90a8-511805f53b1e from snapshot v_1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:15:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d008e95b-53f5-4f90-bf37-3600faa6db7b/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d008e95b-53f5-4f90-bf37-3600faa6db7b/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_d008e95b-53f5-4f90-bf37-3600faa6db7b@v_1fe09443-bbf4-4c23-90a8-511805f53b1e', 'is_clone': True, 'full_name': 'Pool-0/v_1fe09443-bbf4-4c23-90a8-511805f53b1e', 'name': 'v_1fe09443-bbf4-4c23-90a8-511805f53b1e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d008e95b-53f5-4f90-bf37-3600faa6db7b/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] get volume v_1fe09443-bbf4-4c23-90a8-511805f53b1e info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:15:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_d008e95b-53f5-4f90-bf37-3600faa6db7b@v_1fe09443-bbf4-4c23-90a8-511805f53b1e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1fe09443-bbf4-4c23-90a8-511805f53b1e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443528', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113486', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13476179991814288733', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1e0be4fe1b1cfe0d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265497600', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85631', 'name': 'v_1fe09443-bbf4-4c23-90a8-511805f53b1e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1889ba94-8e2b-4fef-a308-89cf69e75efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fe09443-bbf4-4c23-90a8-511805f53b1e', 'volume_size': 1, 'snapshot_id': 'd008e95b-53f5-4f90-bf37-3600faa6db7b'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9983a1cb-4e56-4e28-801e-c9447e5ef589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:19 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Volume volume-1fe09443-bbf4-4c23-90a8-511805f53b1e (1fe09443-bbf4-4c23-90a8-511805f53b1e): created successfully Apr 14 03:15:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9983a1cb-4e56-4e28-801e-c9447e5ef589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:19 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Flow 'volume_create_manager' (22dd167a-9a04-4b4b-8352-a500ad00421f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:15:19 user cinder-volume[73403]: INFO cinder.volume.manager [None req-d6e04276-28d7-4505-a524-1c55d9a79dac tempest-VolumesSnapshotTestJSON-423841644 None] Created volume successfully. Apr 14 03:15:20 user cinder-volume[73403]: DEBUG cinder.coordination [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Acquiring lock "cinder-1fe09443-bbf4-4c23-90a8-511805f53b1e-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:15:20 user cinder-volume[73403]: DEBUG cinder.coordination [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-1fe09443-bbf4-4c23-90a8-511805f53b1e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:15:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] remove_export for volume: 1fe09443-bbf4-4c23-90a8-511805f53b1e. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:15:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:15:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-480070847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1fe09443-bbf4-4c23-90a8-511805f53b1e,launched_at=2023-04-14T03:15:20Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4549f6080dcf4c739ac03ef643801fbc',provider_auth='CHAP lvNktGBA YRUr2Thm3AD1Qs',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe09443-bbf4-4c23-90a8-511805f53b1e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:17Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=d008e95b-53f5-4f90-bf37-3600faa6db7b,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:15:21Z,updated_at=2023-04-14T03:15:21Z,use_quota=True,user_id='0128a733bd6a4120addba5eda1cc05fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:1fe09443-bbf4-4c23-90a8-511805f53b1e. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:15:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] detach volume v_1fe09443-bbf4-4c23-90a8-511805f53b1e from target iqn.2010-10.org.openstack:1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:15:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1fe09443-bbf4-4c23-90a8-511805f53b1e/luns/v_1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1fe09443-bbf4-4c23-90a8-511805f53b1e/luns/v_1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1fe09443-bbf4-4c23-90a8-511805f53b1e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1fe09443-bbf4-4c23-90a8-511805f53b1e/luns/v_1fe09443-bbf4-4c23-90a8-511805f53b1e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1fe09443-bbf4-4c23-90a8-511805f53b1e/luns/v_1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] failed to remove resource iqn.2010-10.org.openstack:1fe09443-bbf4-4c23-90a8-511805f53b1e because of JDSS resource v_1fe09443-bbf4-4c23-90a8-511805f53b1e DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:15:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] delete target: iqn.2010-10.org.openstack:1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:15:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] delete target iqn.2010-10.org.openstack:1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:15:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1fe09443-bbf4-4c23-90a8-511805f53b1e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1fe09443-bbf4-4c23-90a8-511805f53b1e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] failed to remove resource iqn.2010-10.org.openstack:1fe09443-bbf4-4c23-90a8-511805f53b1e because of JDSS resource iqn.2010-10.org.openstack:1fe09443-bbf4-4c23-90a8-511805f53b1e DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:15:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] deleating volume v_1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:15:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] get snapshots for volume v_1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:15:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1fe09443-bbf4-4c23-90a8-511805f53b1e/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1fe09443-bbf4-4c23-90a8-511805f53b1e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1fe09443-bbf4-4c23-90a8-511805f53b1e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] get volume v_1fe09443-bbf4-4c23-90a8-511805f53b1e info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:15:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_d008e95b-53f5-4f90-bf37-3600faa6db7b@v_1fe09443-bbf4-4c23-90a8-511805f53b1e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1fe09443-bbf4-4c23-90a8-511805f53b1e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443528', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113486', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13476179991814288733', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1e0be4fe1b1cfe0d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265497600', 'san:volume_id': '1e0be4fe1b1cfe0d5f482cba19c8727b685f5b58', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85631', 'name': 'v_1fe09443-bbf4-4c23-90a8-511805f53b1e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] delete snapshot v_1fe09443-bbf4-4c23-90a8-511805f53b1e of volume s_d008e95b-53f5-4f90-bf37-3600faa6db7b {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:15:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d008e95b-53f5-4f90-bf37-3600faa6db7b/snapshots/v_1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d008e95b-53f5-4f90-bf37-3600faa6db7b/snapshots/v_1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d008e95b-53f5-4f90-bf37-3600faa6db7b/snapshots/v_1fe09443-bbf4-4c23-90a8-511805f53b1e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] snapshot v_1fe09443-bbf4-4c23-90a8-511805f53b1e deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:15:22 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=63,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=7 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:15:22 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=60,cinder:UPDATE=31,cinder:INSERT=5,cinder:DELETE=4 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:15:23 user cinder-volume[73403]: DEBUG cinder.quota [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Created reservations ['0ea5b56b-095d-4172-ae14-ea84119d2d0c', '0ac62760-fef4-488a-95f0-517d95a43cfd', 'ba6c78e9-a809-41c9-a894-27bdb87e3d7c', '533d4a42-2aea-474c-9631-a1ea6cb00bef'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:15:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:15:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:15:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'available': '114265522176', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:15:23 user cinder-volume[73403]: DEBUG cinder.manager [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:15:23 user cinder-volume[73403]: INFO cinder.volume.manager [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Deleted volume successfully. Apr 14 03:15:23 user cinder-volume[73403]: DEBUG cinder.coordination [None req-bfe8257e-d757-45f2-a492-319b7bdfcede tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-1fe09443-bbf4-4c23-90a8-511805f53b1e-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:15:23 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a1323d3c-502a-41a3-940d-1f823d156d06 tempest-VolumesSnapshotTestJSON-423841644 None] Acquiring lock "cinder-d008e95b-53f5-4f90-bf37-3600faa6db7b-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:15:23 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a1323d3c-502a-41a3-940d-1f823d156d06 tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-d008e95b-53f5-4f90-bf37-3600faa6db7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:15:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1323d3c-502a-41a3-940d-1f823d156d06 tempest-VolumesSnapshotTestJSON-423841644 None] deleating snapshot s_d008e95b-53f5-4f90-bf37-3600faa6db7b. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:15:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1323d3c-502a-41a3-940d-1f823d156d06 tempest-VolumesSnapshotTestJSON-423841644 None] get snapshots for volume s_d008e95b-53f5-4f90-bf37-3600faa6db7b {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:15:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1323d3c-502a-41a3-940d-1f823d156d06 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d008e95b-53f5-4f90-bf37-3600faa6db7b/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1323d3c-502a-41a3-940d-1f823d156d06 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d008e95b-53f5-4f90-bf37-3600faa6db7b/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1323d3c-502a-41a3-940d-1f823d156d06 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d008e95b-53f5-4f90-bf37-3600faa6db7b/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1323d3c-502a-41a3-940d-1f823d156d06 tempest-VolumesSnapshotTestJSON-423841644 None] get volume s_d008e95b-53f5-4f90-bf37-3600faa6db7b info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:15:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1323d3c-502a-41a3-940d-1f823d156d06 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d008e95b-53f5-4f90-bf37-3600faa6db7b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1323d3c-502a-41a3-940d-1f823d156d06 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d008e95b-53f5-4f90-bf37-3600faa6db7b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1323d3c-502a-41a3-940d-1f823d156d06 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d182efd3-7620-422e-a0c2-ecc0d77851f1@s_d008e95b-53f5-4f90-bf37-3600faa6db7b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_d008e95b-53f5-4f90-bf37-3600faa6db7b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443525', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113480', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5699711313204115039', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '12f0704292d2d319', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265522176', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85615', 'name': 's_d008e95b-53f5-4f90-bf37-3600faa6db7b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d008e95b-53f5-4f90-bf37-3600faa6db7b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1323d3c-502a-41a3-940d-1f823d156d06 tempest-VolumesSnapshotTestJSON-423841644 None] delete snapshot s_d008e95b-53f5-4f90-bf37-3600faa6db7b of volume v_d182efd3-7620-422e-a0c2-ecc0d77851f1 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:15:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1323d3c-502a-41a3-940d-1f823d156d06 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d182efd3-7620-422e-a0c2-ecc0d77851f1/snapshots/s_d008e95b-53f5-4f90-bf37-3600faa6db7b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1323d3c-502a-41a3-940d-1f823d156d06 tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d182efd3-7620-422e-a0c2-ecc0d77851f1/snapshots/s_d008e95b-53f5-4f90-bf37-3600faa6db7b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1323d3c-502a-41a3-940d-1f823d156d06 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d182efd3-7620-422e-a0c2-ecc0d77851f1/snapshots/s_d008e95b-53f5-4f90-bf37-3600faa6db7b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1323d3c-502a-41a3-940d-1f823d156d06 tempest-VolumesSnapshotTestJSON-423841644 None] snapshot s_d008e95b-53f5-4f90-bf37-3600faa6db7b deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:15:26 user cinder-volume[73403]: DEBUG cinder.quota [None req-a1323d3c-502a-41a3-940d-1f823d156d06 tempest-VolumesSnapshotTestJSON-423841644 None] Created reservations ['a604eb60-8a76-4fd7-9231-e74d8fd372fc', 'b438f667-66b0-4d8f-803d-abbf210c6385', 'afcec209-46a5-4425-b3db-e0108712d19b', 'bcf4c319-eda8-41eb-b57f-425c16ae5b02'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:15:26 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a1323d3c-502a-41a3-940d-1f823d156d06 tempest-VolumesSnapshotTestJSON-423841644 None] Delete snapshot completed successfully. Apr 14 03:15:26 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a1323d3c-502a-41a3-940d-1f823d156d06 tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-d008e95b-53f5-4f90-bf37-3600faa6db7b-delete_snapshot" released by "delete_snapshot" :: held 2.287s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:15:27 user cinder-volume[73403]: DEBUG cinder.coordination [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Acquiring lock "cinder-d182efd3-7620-422e-a0c2-ecc0d77851f1-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:15:27 user cinder-volume[73403]: DEBUG cinder.coordination [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-d182efd3-7620-422e-a0c2-ecc0d77851f1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:15:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] remove_export for volume: d182efd3-7620-422e-a0c2-ecc0d77851f1. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:15:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:15:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1112270743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d182efd3-7620-422e-a0c2-ecc0d77851f1,launched_at=2023-04-14T03:15:15Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4549f6080dcf4c739ac03ef643801fbc',provider_auth='CHAP NGtTeuSj nveKzoc4PL50C9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d182efd3-7620-422e-a0c2-ecc0d77851f1 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:14Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:15:27Z,updated_at=2023-04-14T03:15:27Z,use_quota=True,user_id='0128a733bd6a4120addba5eda1cc05fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:d182efd3-7620-422e-a0c2-ecc0d77851f1. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:15:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] detach volume v_d182efd3-7620-422e-a0c2-ecc0d77851f1 from target iqn.2010-10.org.openstack:d182efd3-7620-422e-a0c2-ecc0d77851f1 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:15:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d182efd3-7620-422e-a0c2-ecc0d77851f1/luns/v_d182efd3-7620-422e-a0c2-ecc0d77851f1 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d182efd3-7620-422e-a0c2-ecc0d77851f1/luns/v_d182efd3-7620-422e-a0c2-ecc0d77851f1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d182efd3-7620-422e-a0c2-ecc0d77851f1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d182efd3-7620-422e-a0c2-ecc0d77851f1/luns/v_d182efd3-7620-422e-a0c2-ecc0d77851f1'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d182efd3-7620-422e-a0c2-ecc0d77851f1/luns/v_d182efd3-7620-422e-a0c2-ecc0d77851f1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] failed to remove resource iqn.2010-10.org.openstack:d182efd3-7620-422e-a0c2-ecc0d77851f1 because of JDSS resource v_d182efd3-7620-422e-a0c2-ecc0d77851f1 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:15:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] delete target: iqn.2010-10.org.openstack:d182efd3-7620-422e-a0c2-ecc0d77851f1 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:15:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] delete target iqn.2010-10.org.openstack:d182efd3-7620-422e-a0c2-ecc0d77851f1 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:15:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d182efd3-7620-422e-a0c2-ecc0d77851f1 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d182efd3-7620-422e-a0c2-ecc0d77851f1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d182efd3-7620-422e-a0c2-ecc0d77851f1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d182efd3-7620-422e-a0c2-ecc0d77851f1'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d182efd3-7620-422e-a0c2-ecc0d77851f1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] failed to remove resource iqn.2010-10.org.openstack:d182efd3-7620-422e-a0c2-ecc0d77851f1 because of JDSS resource iqn.2010-10.org.openstack:d182efd3-7620-422e-a0c2-ecc0d77851f1 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:15:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] deleating volume v_d182efd3-7620-422e-a0c2-ecc0d77851f1 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:15:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] get snapshots for volume v_d182efd3-7620-422e-a0c2-ecc0d77851f1 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:15:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d182efd3-7620-422e-a0c2-ecc0d77851f1/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d182efd3-7620-422e-a0c2-ecc0d77851f1/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d182efd3-7620-422e-a0c2-ecc0d77851f1/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] get volume v_d182efd3-7620-422e-a0c2-ecc0d77851f1 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:15:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d182efd3-7620-422e-a0c2-ecc0d77851f1 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d182efd3-7620-422e-a0c2-ecc0d77851f1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d182efd3-7620-422e-a0c2-ecc0d77851f1', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443523', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113474', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11535224942093039467', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '755f4596f44498d2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265509888', 'san:volume_id': '755f4596f44498d200e6527fd958f4bc3c4929cd', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86320', 'name': 'v_d182efd3-7620-422e-a0c2-ecc0d77851f1', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d182efd3-7620-422e-a0c2-ecc0d77851f1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] delete volume:v_d182efd3-7620-422e-a0c2-ecc0d77851f1 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:15:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d182efd3-7620-422e-a0c2-ecc0d77851f1 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d182efd3-7620-422e-a0c2-ecc0d77851f1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d182efd3-7620-422e-a0c2-ecc0d77851f1 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] volume v_d182efd3-7620-422e-a0c2-ecc0d77851f1 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:15:29 user cinder-volume[73403]: DEBUG cinder.quota [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Created reservations ['d7641403-ff3b-410f-b768-4cd35ecac634', 'a520788d-eded-42d6-99cb-b2575c1711ad', '680c607b-074c-4741-adf8-c4a9936cda9a', 'f53c0e7f-a6c8-4bf2-9e88-0548a6155a74'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:15:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:15:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:15:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'available': '114265604096', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.manager [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:15:30 user cinder-volume[73403]: INFO cinder.volume.manager [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Deleted volume successfully. Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.coordination [None req-160f3d6d-f6e5-4229-aee9-af66499aaad8 tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-d182efd3-7620-422e-a0c2-ecc0d77851f1-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Acquiring lock "cinder-eb69c0bd-af4f-438c-b96a-94c59261813a-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-eb69c0bd-af4f-438c-b96a-94c59261813a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] remove_export for volume: eb69c0bd-af4f-438c-b96a-94c59261813a. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2095910999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=eb69c0bd-af4f-438c-b96a-94c59261813a,launched_at=2023-04-14T03:08:23Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4549f6080dcf4c739ac03ef643801fbc',provider_auth='CHAP pjXgqBiH dPnr7LhVIsNHbG',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:08:21Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:15:31Z,updated_at=2023-04-14T03:15:31Z,use_quota=True,user_id='0128a733bd6a4120addba5eda1cc05fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] detach volume v_eb69c0bd-af4f-438c-b96a-94c59261813a from target iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a/luns/v_eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a/luns/v_eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a/luns/v_eb69c0bd-af4f-438c-b96a-94c59261813a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a/luns/v_eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] failed to remove resource iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a because of JDSS resource v_eb69c0bd-af4f-438c-b96a-94c59261813a DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] delete target: iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] delete target iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] failed to remove resource iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a because of JDSS resource iqn.2010-10.org.openstack:eb69c0bd-af4f-438c-b96a-94c59261813a DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] deleating volume v_eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] get snapshots for volume v_eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] get volume v_eb69c0bd-af4f-438c-b96a-94c59261813a info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Flow 'volume_create_manager' (05e3eca6-df16-42f0-84d1-67efc337793f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1903c46-3830-4781-9e95-fd3f34ca9a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_eb69c0bd-af4f-438c-b96a-94c59261813a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443111', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113127', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6042859815097504277', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a01ac2fd9f613482', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265604096', 'san:volume_id': 'a01ac2fd9f613482aa4efd62dcc3f452e6f2d630', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85202', 'name': 'v_eb69c0bd-af4f-438c-b96a-94c59261813a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] delete volume:v_eb69c0bd-af4f-438c-b96a-94c59261813a recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1903c46-3830-4781-9e95-fd3f34ca9a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1380512440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0096d0892acf4d5f8a0fa290a18b451a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:15:31Z,use_quota=True,user_id='ba8614e27c65428d92e4bf01969976e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6005a8ed-97ac-4443-80af-ba1c6b8182a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6005a8ed-97ac-4443-80af-ba1c6b8182a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7399ab30-98ec-4292-ab89-1147a9979ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7399ab30-98ec-4292-ab89-1147a9979ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd51ab0f1-4bb3-4e37-bb8e-8c3199935e9e', 'volume_name': 'volume-d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc735528-e58a-4b01-bf3f-664b7c409542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc735528-e58a-4b01-bf3f-664b7c409542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6968a853-4437-4dde-9d18-35e7f80a75a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:31 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Volume d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e', 'volume_size': 1} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] creating volume v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] create volume {'name': 'v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e', 'is_clone': False, 'name': 'v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6968a853-4437-4dde-9d18-35e7f80a75a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89b470b-3304-452a-82e9-c1e5e2e0ba59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:32 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Volume volume-d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e (d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e): created successfully Apr 14 03:15:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89b470b-3304-452a-82e9-c1e5e2e0ba59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Flow 'volume_create_manager' (05e3eca6-df16-42f0-84d1-67efc337793f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:15:32 user cinder-volume[73403]: INFO cinder.volume.manager [None req-7e501308-6223-4f61-a2e8-a8018d1affab tempest-SnapshotDataIntegrityTests-450991924 None] Created volume successfully. Apr 14 03:15:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb69c0bd-af4f-438c-b96a-94c59261813a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] volume v_eb69c0bd-af4f-438c-b96a-94c59261813a deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:15:33 user cinder-volume[73403]: DEBUG cinder.quota [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Created reservations ['30b9a99c-b4e5-4a3f-8891-d64801d4e75d', '90bcd3fe-2520-4650-ab33-cdf882245f62', '32fd49d2-6898-479e-bedd-fb2587ec96ce', 'cf120360-ecb4-4d6d-be7d-fd71c469349c'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:15:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:15:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:15:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Geting {'code': 200, 'error': None, 'data': {'available': '114265591808', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:15:34 user cinder-volume[73403]: DEBUG cinder.manager [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:15:34 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Deleted volume successfully. Apr 14 03:15:34 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8fc89a1f-3b94-4fb0-aed2-f3511ca8a558 tempest-VolumesSnapshotTestJSON-423841644 None] Lock "cinder-eb69c0bd-af4f-438c-b96a-94c59261813a-delete_volume" released by "delete_volume" :: held 3.417s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:15:35 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Acquiring lock "cinder-0ae128f0-64ab-4413-bae2-15cd90212c53-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:15:35 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-0ae128f0-64ab-4413-bae2-15cd90212c53-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:15:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] remove_export for volume: 0ae128f0-64ab-4413-bae2-15cd90212c53. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:15:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:15:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-1785204424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0ae128f0-64ab-4413-bae2-15cd90212c53,launched_at=2023-04-14T03:12:50Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2e49e8e92e416faebf55e3d4e0e087',provider_auth='CHAP tyovbWPn NQ8AT432BfjnWo',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:12:48Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=ed48619f-2a10-4992-8c6d-6520e0d6f7ba,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:15:36Z,updated_at=2023-04-14T03:15:36Z,use_quota=True,user_id='60e11b7ab2914209b23bf7a53791da64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:15:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] detach volume v_0ae128f0-64ab-4413-bae2-15cd90212c53 from target iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:15:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53/luns/v_0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53/luns/v_0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53/luns/v_0ae128f0-64ab-4413-bae2-15cd90212c53'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53/luns/v_0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] failed to remove resource iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 because of JDSS resource v_0ae128f0-64ab-4413-bae2-15cd90212c53 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:15:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] delete target: iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:15:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] delete target iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:15:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] failed to remove resource iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 because of JDSS resource iqn.2010-10.org.openstack:0ae128f0-64ab-4413-bae2-15cd90212c53 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:15:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] deleating volume v_0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:15:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] get snapshots for volume v_0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:15:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ae128f0-64ab-4413-bae2-15cd90212c53/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ae128f0-64ab-4413-bae2-15cd90212c53/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ae128f0-64ab-4413-bae2-15cd90212c53/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] get volume v_0ae128f0-64ab-4413-bae2-15cd90212c53 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:15:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba@v_0ae128f0-64ab-4413-bae2-15cd90212c53', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_0ae128f0-64ab-4413-bae2-15cd90212c53', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443378', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26120192', 'sharesmb': None, 'createtxg': '113344', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5128266426500650152', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '266240', 'logicalused': '1097728', 'compressratio': '5.05', 'rootcontext': 'none', 'default_scsi_id': '4ecc76451de02704', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265591808', 'san:volume_id': '4ecc76451de02704de2d9e2f0f660461f66a4ceb', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.68', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '266240', 'objsetid': '84805', 'name': 'v_0ae128f0-64ab-4413-bae2-15cd90212c53', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '266240', 'logicalreferenced': '43855872', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] delete snapshot v_0ae128f0-64ab-4413-bae2-15cd90212c53 of volume s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:15:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba/snapshots/v_0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba/snapshots/v_0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] create export for volume: d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:15:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] ensure volume d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:15:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] check if targe iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:15:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] create target and attach volume d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:15:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] create target iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:15:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:INSERT=9,cinder:SELECT=55,cinder:UPDATE=35,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Flow 'volume_create_manager' (30f6d484-e3af-41b1-994e-610e5b24187f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee680991-0fe7-45b8-81b4-528617319c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee680991-0fe7-45b8-81b4-528617319c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1100969330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a70edf93-9f37-4097-9642-ed1fc4802294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cacf79308fe4bab8e28479c9bbc26ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:15:37Z,use_quota=True,user_id='acb0a910c48d48d29c164289b2d26333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668f9180-141a-4e61-8de5-560edcfaa886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668f9180-141a-4e61-8de5-560edcfaa886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b404561-3ac9-43e3-a95e-e1cb4161b20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b404561-3ac9-43e3-a95e-e1cb4161b20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a70edf93-9f37-4097-9642-ed1fc4802294', 'volume_name': 'volume-a70edf93-9f37-4097-9642-ed1fc4802294', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed6be53-6c87-4e9c-b0f1-2df80afd61f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed6be53-6c87-4e9c-b0f1-2df80afd61f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bba83f9-c480-42aa-98f4-804b6ca10e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:37 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Volume a70edf93-9f37-4097-9642-ed1fc4802294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a70edf93-9f37-4097-9642-ed1fc4802294', 'volume_size': 1} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] creating volume v_a70edf93-9f37-4097-9642-ed1fc4802294. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] create volume {'name': 'v_a70edf93-9f37-4097-9642-ed1fc4802294', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Flow 'volume_create_manager' (c0800116-5e2c-4e67-b3de-ea3fd671aac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e288fa-8c12-402c-9e51-b1db0bd46d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e288fa-8c12-402c-9e51-b1db0bd46d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1968576305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cacf79308fe4bab8e28479c9bbc26ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:15:37Z,use_quota=True,user_id='acb0a910c48d48d29c164289b2d26333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0fdf61-376c-448b-8b4c-7989c3eb039f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0fdf61-376c-448b-8b4c-7989c3eb039f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a3dc90-e656-45d6-96e7-c9e1c0a34260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a3dc90-e656-45d6-96e7-c9e1c0a34260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f', 'volume_name': 'volume-81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc17dcc4-349d-44ad-ab44-7558569eb610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc17dcc4-349d-44ad-ab44-7558569eb610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b11e01d-d7e1-4ed4-b8e8-2250bf26df57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:37 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Volume 81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f', 'volume_size': 1} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] creating volume v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] create volume {'name': 'v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Flow 'volume_create_manager' (d6be38c9-96fb-45df-a4b5-8959f19867f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21f859e-ccc5-4c1c-abc7-df09e3d86064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21f859e-ccc5-4c1c-abc7-df09e3d86064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-424816728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=56dc5690-26ec-440a-aee9-99166159e67b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cacf79308fe4bab8e28479c9bbc26ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:15:38Z,use_quota=True,user_id='acb0a910c48d48d29c164289b2d26333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ca332d-0a2e-4f92-8524-544a68486c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ca332d-0a2e-4f92-8524-544a68486c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402aeaf3-0199-42c2-bff4-db348744a7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402aeaf3-0199-42c2-bff4-db348744a7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56dc5690-26ec-440a-aee9-99166159e67b', 'volume_name': 'volume-56dc5690-26ec-440a-aee9-99166159e67b', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c768cf-be9d-4321-97d7-992ab9d8ab44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c768cf-be9d-4321-97d7-992ab9d8ab44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c299ad9-8d09-41d1-b797-47be87bed11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:37 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Volume 56dc5690-26ec-440a-aee9-99166159e67b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56dc5690-26ec-440a-aee9-99166159e67b', 'volume_size': 1} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] creating volume v_56dc5690-26ec-440a-aee9-99166159e67b. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] create volume {'name': 'v_56dc5690-26ec-440a-aee9-99166159e67b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Flow 'volume_create_manager' (993f97ba-41f2-4e92-a65e-2abd8ea2b99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a398195-9c3c-4084-a4fb-660ee22f1663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a398195-9c3c-4084-a4fb-660ee22f1663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-983263312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=efa19602-89a1-45de-bb87-b01c39979326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cacf79308fe4bab8e28479c9bbc26ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:15:38Z,use_quota=True,user_id='acb0a910c48d48d29c164289b2d26333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12ca672-7c14-4652-8960-8e84feaabe35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12ca672-7c14-4652-8960-8e84feaabe35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb45f84f-715c-4ddf-a242-971aad74513f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb45f84f-715c-4ddf-a242-971aad74513f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efa19602-89a1-45de-bb87-b01c39979326', 'volume_name': 'volume-efa19602-89a1-45de-bb87-b01c39979326', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefdc5b1-9390-4c9a-9472-88ebff1e06bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefdc5b1-9390-4c9a-9472-88ebff1e06bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ce3b82-9d65-44ae-9c73-c010b9753e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:37 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Volume efa19602-89a1-45de-bb87-b01c39979326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efa19602-89a1-45de-bb87-b01c39979326', 'volume_size': 1} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] creating volume v_efa19602-89a1-45de-bb87-b01c39979326. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] create volume {'name': 'v_efa19602-89a1-45de-bb87-b01c39979326', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba/snapshots/v_0ae128f0-64ab-4413-bae2-15cd90212c53 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] snapshot v_0ae128f0-64ab-4413-bae2-15cd90212c53 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=33,cinder:SELECT=57,cinder:DELETE=3,cinder:INSERT=7 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Flow 'volume_create_manager' (8b1e6708-e3d9-4610-876d-13761b8077ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d047884a-6f78-493a-93a4-e0f1daab05ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a70edf93-9f37-4097-9642-ed1fc4802294', 'is_clone': False, 'name': 'v_a70edf93-9f37-4097-9642-ed1fc4802294'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.quota [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Created reservations ['3c7240b4-703a-438e-80de-ba13d5ed7aa4', '2260716a-54ef-455e-aa4c-fc3a95e1499e', '49e41cf0-ad74-4ef1-b134-60a6be065e06', 'a0b7652e-b31d-4766-888e-105175da57d3'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bba83f9-c480-42aa-98f4-804b6ca10e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a70edf93-9f37-4097-9642-ed1fc4802294', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da2901e-56d0-45d8-a86b-39a0ca87870e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d047884a-6f78-493a-93a4-e0f1daab05ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1485404982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3de81520-3f95-4643-bac7-684b1a57c4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cacf79308fe4bab8e28479c9bbc26ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:15:38Z,use_quota=True,user_id='acb0a910c48d48d29c164289b2d26333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbb5e61-2892-459f-baf7-ba2810924271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbb5e61-2892-459f-baf7-ba2810924271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d68e53-c8b3-444f-9c7f-e8357b2310f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d68e53-c8b3-444f-9c7f-e8357b2310f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3de81520-3f95-4643-bac7-684b1a57c4be', 'volume_name': 'volume-3de81520-3f95-4643-bac7-684b1a57c4be', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbf458fa-8a32-45b6-8efd-4fa572a8bd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbf458fa-8a32-45b6-8efd-4fa572a8bd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b99c346-024c-4e0e-befb-3501b203931b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:38 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Volume 3de81520-3f95-4643-bac7-684b1a57c4be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3de81520-3f95-4643-bac7-684b1a57c4be', 'volume_size': 1} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] creating volume v_3de81520-3f95-4643-bac7-684b1a57c4be. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] create volume {'name': 'v_3de81520-3f95-4643-bac7-684b1a57c4be', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:38 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Volume volume-a70edf93-9f37-4097-9642-ed1fc4802294 (a70edf93-9f37-4097-9642-ed1fc4802294): created successfully Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da2901e-56d0-45d8-a86b-39a0ca87870e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Flow 'volume_create_manager' (30f6d484-e3af-41b1-994e-610e5b24187f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:15:38 user cinder-volume[73403]: INFO cinder.volume.manager [None req-defb53f0-a9a6-4e2c-9d36-f83666a962d6 tempest-CreateVolumesFromImageTest-1520597783 None] Created volume successfully. Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f', 'is_clone': False, 'name': 'v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b11e01d-d7e1-4ed4-b8e8-2250bf26df57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926e9d85-2b54-4729-a750-aa0dc517f6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:38 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Volume volume-81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f (81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f): created successfully Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926e9d85-2b54-4729-a750-aa0dc517f6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Flow 'volume_create_manager' (c0800116-5e2c-4e67-b3de-ea3fd671aac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:15:38 user cinder-volume[73403]: INFO cinder.volume.manager [None req-9e4d5ee6-db3d-4575-8184-57011a8feafd tempest-CreateVolumesFromImageTest-1520597783 None] Created volume successfully. Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_56dc5690-26ec-440a-aee9-99166159e67b', 'is_clone': False, 'name': 'v_56dc5690-26ec-440a-aee9-99166159e67b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c299ad9-8d09-41d1-b797-47be87bed11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56dc5690-26ec-440a-aee9-99166159e67b', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad6ab86-0b12-4941-ac0e-cd9245868371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:39 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Volume volume-56dc5690-26ec-440a-aee9-99166159e67b (56dc5690-26ec-440a-aee9-99166159e67b): created successfully Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad6ab86-0b12-4941-ac0e-cd9245868371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Flow 'volume_create_manager' (d6be38c9-96fb-45df-a4b5-8959f19867f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:15:39 user cinder-volume[73403]: INFO cinder.volume.manager [None req-20441da2-622b-4bc4-af82-95023584c640 tempest-CreateVolumesFromImageTest-1520597783 None] Created volume successfully. Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.coordination [None req-78ead7a5-b614-4cf0-b174-f19d9357527c tempest-TestVolumeBootPattern-910285030 None] Acquiring lock "cinder-ed48619f-2a10-4992-8c6d-6520e0d6f7ba-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.coordination [None req-78ead7a5-b614-4cf0-b174-f19d9357527c tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-ed48619f-2a10-4992-8c6d-6520e0d6f7ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-78ead7a5-b614-4cf0-b174-f19d9357527c tempest-TestVolumeBootPattern-910285030 None] deleating snapshot s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-78ead7a5-b614-4cf0-b174-f19d9357527c tempest-TestVolumeBootPattern-910285030 None] get snapshots for volume s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78ead7a5-b614-4cf0-b174-f19d9357527c tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78ead7a5-b614-4cf0-b174-f19d9357527c tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_efa19602-89a1-45de-bb87-b01c39979326', 'is_clone': False, 'name': 'v_efa19602-89a1-45de-bb87-b01c39979326'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ce3b82-9d65-44ae-9c73-c010b9753e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efa19602-89a1-45de-bb87-b01c39979326', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279c3ec2-108f-4e8f-b1a2-83913b8dd389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:39 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Volume volume-efa19602-89a1-45de-bb87-b01c39979326 (efa19602-89a1-45de-bb87-b01c39979326): created successfully Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279c3ec2-108f-4e8f-b1a2-83913b8dd389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Flow 'volume_create_manager' (993f97ba-41f2-4e92-a65e-2abd8ea2b99a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:15:39 user cinder-volume[73403]: INFO cinder.volume.manager [None req-05ffefc8-33b1-43e8-abff-79bee71d2599 tempest-CreateVolumesFromImageTest-1520597783 None] Created volume successfully. Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] atach volume v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e to target iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'available': '114265559040', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.manager [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:15:39 user cinder-volume[73403]: INFO cinder.volume.manager [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Deleted volume successfully. Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5bc40740-0f00-4692-a046-efc112b277f9 tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-0ae128f0-64ab-4413-bae2-15cd90212c53-delete_volume" released by "delete_volume" :: held 4.109s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_3de81520-3f95-4643-bac7-684b1a57c4be', 'is_clone': False, 'name': 'v_3de81520-3f95-4643-bac7-684b1a57c4be'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b99c346-024c-4e0e-befb-3501b203931b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3de81520-3f95-4643-bac7-684b1a57c4be', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77699019-13df-4594-b2b7-d10ebea8aff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:39 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Volume volume-3de81520-3f95-4643-bac7-684b1a57c4be (3de81520-3f95-4643-bac7-684b1a57c4be): created successfully Apr 14 03:15:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77699019-13df-4594-b2b7-d10ebea8aff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Flow 'volume_create_manager' (8b1e6708-e3d9-4610-876d-13761b8077ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:15:40 user cinder-volume[73403]: INFO cinder.volume.manager [None req-309b308c-a165-4f1d-838e-81d2097d0883 tempest-CreateVolumesFromImageTest-1520597783 None] Created volume successfully. Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Acquiring lock "cinder-3de81520-3f95-4643-bac7-684b1a57c4be-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Lock "cinder-3de81520-3f95-4643-bac7-684b1a57c4be-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78ead7a5-b614-4cf0-b174-f19d9357527c tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-78ead7a5-b614-4cf0-b174-f19d9357527c tempest-TestVolumeBootPattern-910285030 None] get volume s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78ead7a5-b614-4cf0-b174-f19d9357527c tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78ead7a5-b614-4cf0-b174-f19d9357527c tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] remove_export for volume: 3de81520-3f95-4643-bac7-684b1a57c4be. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1485404982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3de81520-3f95-4643-bac7-684b1a57c4be,launched_at=2023-04-14T03:15:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cacf79308fe4bab8e28479c9bbc26ab',provider_auth='CHAP aEjynceU U53KOchfVyrtpT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de81520-3f95-4643-bac7-684b1a57c4be 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:38Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:15:40Z,updated_at=2023-04-14T03:15:40Z,use_quota=True,user_id='acb0a910c48d48d29c164289b2d26333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:3de81520-3f95-4643-bac7-684b1a57c4be. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] detach volume v_3de81520-3f95-4643-bac7-684b1a57c4be from target iqn.2010-10.org.openstack:3de81520-3f95-4643-bac7-684b1a57c4be {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3de81520-3f95-4643-bac7-684b1a57c4be/luns/v_3de81520-3f95-4643-bac7-684b1a57c4be {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3de81520-3f95-4643-bac7-684b1a57c4be/luns/v_3de81520-3f95-4643-bac7-684b1a57c4be {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78ead7a5-b614-4cf0-b174-f19d9357527c tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c6fbfee2-70fa-477a-a761-8d092061e691@s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443374', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26116096', 'sharesmb': None, 'createtxg': '113338', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4759681510857198600', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f98cf4a5f95ddfc1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265546752', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '84703', 'name': 's_ed48619f-2a10-4992-8c6d-6520e0d6f7ba', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-78ead7a5-b614-4cf0-b174-f19d9357527c tempest-TestVolumeBootPattern-910285030 None] delete snapshot s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba of volume v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78ead7a5-b614-4cf0-b174-f19d9357527c tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6fbfee2-70fa-477a-a761-8d092061e691/snapshots/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78ead7a5-b614-4cf0-b174-f19d9357527c tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6fbfee2-70fa-477a-a761-8d092061e691/snapshots/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3de81520-3f95-4643-bac7-684b1a57c4be not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3de81520-3f95-4643-bac7-684b1a57c4be/luns/v_3de81520-3f95-4643-bac7-684b1a57c4be'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3de81520-3f95-4643-bac7-684b1a57c4be/luns/v_3de81520-3f95-4643-bac7-684b1a57c4be {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] failed to remove resource iqn.2010-10.org.openstack:3de81520-3f95-4643-bac7-684b1a57c4be because of JDSS resource v_3de81520-3f95-4643-bac7-684b1a57c4be DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] delete target: iqn.2010-10.org.openstack:3de81520-3f95-4643-bac7-684b1a57c4be {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] delete target iqn.2010-10.org.openstack:3de81520-3f95-4643-bac7-684b1a57c4be {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3de81520-3f95-4643-bac7-684b1a57c4be {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3de81520-3f95-4643-bac7-684b1a57c4be {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6466363764356137', 'lun': 0, 'mode': 'wt', 'name': 'v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e', 'prod_id': 'Storage', 'scsi_id': 'df67d5a7d8ca4764'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] add credentails to target iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 201, 'error': None, 'data': {'name': 'QsIZOXnq'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] initialize_connection for d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:15:41 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsIZOXnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'f43baa05-9a69-4e42-9354-87cf3649e8f6'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:15:41 user cinder-volume[73403]: INFO cinder.volume.manager [req-05135c56-cc6d-4210-8c64-d96fe03acb9c req-a41199a9-3828-4ead-bf89-a0cef0141e59 tempest-SnapshotDataIntegrityTests-450991924 None] attachment_update completed successfully. Apr 14 03:15:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-78ead7a5-b614-4cf0-b174-f19d9357527c tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6fbfee2-70fa-477a-a761-8d092061e691/snapshots/s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-78ead7a5-b614-4cf0-b174-f19d9357527c tempest-TestVolumeBootPattern-910285030 None] snapshot s_ed48619f-2a10-4992-8c6d-6520e0d6f7ba deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:15:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3de81520-3f95-4643-bac7-684b1a57c4be not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3de81520-3f95-4643-bac7-684b1a57c4be'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3de81520-3f95-4643-bac7-684b1a57c4be {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] failed to remove resource iqn.2010-10.org.openstack:3de81520-3f95-4643-bac7-684b1a57c4be because of JDSS resource iqn.2010-10.org.openstack:3de81520-3f95-4643-bac7-684b1a57c4be DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:15:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] deleating volume v_3de81520-3f95-4643-bac7-684b1a57c4be {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:15:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] get snapshots for volume v_3de81520-3f95-4643-bac7-684b1a57c4be {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:15:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3de81520-3f95-4643-bac7-684b1a57c4be/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3de81520-3f95-4643-bac7-684b1a57c4be/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:42 user cinder-volume[73403]: DEBUG cinder.quota [None req-78ead7a5-b614-4cf0-b174-f19d9357527c tempest-TestVolumeBootPattern-910285030 None] Created reservations ['1ac8c7ea-c418-4757-8dcf-9a63aed03793', 'b5985c45-f5d6-4baf-b503-6b6b8109f989', 'd6ecdab9-1b23-4055-9da4-c3e487c66132', '135135d4-3120-4f28-9613-af29d462b834'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:15:42 user cinder-volume[73403]: INFO cinder.volume.manager [None req-78ead7a5-b614-4cf0-b174-f19d9357527c tempest-TestVolumeBootPattern-910285030 None] Delete snapshot completed successfully. Apr 14 03:15:42 user cinder-volume[73403]: DEBUG cinder.coordination [None req-78ead7a5-b614-4cf0-b174-f19d9357527c tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-ed48619f-2a10-4992-8c6d-6520e0d6f7ba-delete_snapshot" released by "delete_snapshot" :: held 3.058s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:15:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3de81520-3f95-4643-bac7-684b1a57c4be/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] get volume v_3de81520-3f95-4643-bac7-684b1a57c4be info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:15:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3de81520-3f95-4643-bac7-684b1a57c4be {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3de81520-3f95-4643-bac7-684b1a57c4be {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_3de81520-3f95-4643-bac7-684b1a57c4be', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443548', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113523', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6150177540480285747', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'df6db357fe9a9bcb', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265792512', 'san:volume_id': 'df6db357fe9a9bcbf449ed60ec15fa227ca2fcfd', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84862', 'name': 'v_3de81520-3f95-4643-bac7-684b1a57c4be', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3de81520-3f95-4643-bac7-684b1a57c4be {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] delete volume:v_3de81520-3f95-4643-bac7-684b1a57c4be recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:15:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3de81520-3f95-4643-bac7-684b1a57c4be {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3de81520-3f95-4643-bac7-684b1a57c4be {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3de81520-3f95-4643-bac7-684b1a57c4be {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] volume v_3de81520-3f95-4643-bac7-684b1a57c4be deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:15:44 user cinder-volume[73403]: DEBUG cinder.quota [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Created reservations ['05e03f78-93f6-4c9a-b8a1-b45f5c79f3b7', 'a3391228-9ac8-47ff-99b9-c47047378557', '0b1ad98b-7887-46fa-81af-df32174441e6', 'a13e6512-6214-4357-bfeb-29a38c9e49fa'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:15:44 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=59,cinder:INSERT=7,cinder:UPDATE=31,cinder:DELETE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:15:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:15:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:15:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:44 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Acquiring lock "cinder-efa19602-89a1-45de-bb87-b01c39979326-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:15:44 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Lock "cinder-efa19602-89a1-45de-bb87-b01c39979326-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:15:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] remove_export for volume: efa19602-89a1-45de-bb87-b01c39979326. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:15:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:15:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-983263312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=efa19602-89a1-45de-bb87-b01c39979326,launched_at=2023-04-14T03:15:39Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cacf79308fe4bab8e28479c9bbc26ab',provider_auth='CHAP RQYoanXi sjWtucaKd4PGBz',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:efa19602-89a1-45de-bb87-b01c39979326 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:38Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:15:45Z,updated_at=2023-04-14T03:15:45Z,use_quota=True,user_id='acb0a910c48d48d29c164289b2d26333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:efa19602-89a1-45de-bb87-b01c39979326. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:15:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] detach volume v_efa19602-89a1-45de-bb87-b01c39979326 from target iqn.2010-10.org.openstack:efa19602-89a1-45de-bb87-b01c39979326 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:15:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:efa19602-89a1-45de-bb87-b01c39979326/luns/v_efa19602-89a1-45de-bb87-b01c39979326 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:efa19602-89a1-45de-bb87-b01c39979326/luns/v_efa19602-89a1-45de-bb87-b01c39979326 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ebb26fd-e063-4c35-bd7d-66debe8e926b tempest-SnapshotDataIntegrityTests-450991924 None] create snapshot 341ddf1e-6211-421f-93dd-c1b4599e2085 for volume d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ebb26fd-e063-4c35-bd7d-66debe8e926b tempest-SnapshotDataIntegrityTests-450991924 None] cloning v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e to s_341ddf1e-6211-421f-93dd-c1b4599e2085 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ebb26fd-e063-4c35-bd7d-66debe8e926b tempest-SnapshotDataIntegrityTests-450991924 None] create snapshot s_341ddf1e-6211-421f-93dd-c1b4599e2085 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ebb26fd-e063-4c35-bd7d-66debe8e926b tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ebb26fd-e063-4c35-bd7d-66debe8e926b tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 200, 'error': None, 'data': {'available': '114265874432', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.manager [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:15:45 user cinder-volume[73403]: INFO cinder.volume.manager [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Deleted volume successfully. Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ae85b6e2-c4cd-4a68-9afe-15a41db05365 tempest-CreateVolumesFromImageTest-1520597783 None] Lock "cinder-3de81520-3f95-4643-bac7-684b1a57c4be-delete_volume" released by "delete_volume" :: held 4.940s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:efa19602-89a1-45de-bb87-b01c39979326 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:efa19602-89a1-45de-bb87-b01c39979326/luns/v_efa19602-89a1-45de-bb87-b01c39979326'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:efa19602-89a1-45de-bb87-b01c39979326/luns/v_efa19602-89a1-45de-bb87-b01c39979326 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] failed to remove resource iqn.2010-10.org.openstack:efa19602-89a1-45de-bb87-b01c39979326 because of JDSS resource v_efa19602-89a1-45de-bb87-b01c39979326 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] delete target: iqn.2010-10.org.openstack:efa19602-89a1-45de-bb87-b01c39979326 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] delete target iqn.2010-10.org.openstack:efa19602-89a1-45de-bb87-b01c39979326 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:efa19602-89a1-45de-bb87-b01c39979326 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:efa19602-89a1-45de-bb87-b01c39979326 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:efa19602-89a1-45de-bb87-b01c39979326 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:efa19602-89a1-45de-bb87-b01c39979326'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:efa19602-89a1-45de-bb87-b01c39979326 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] failed to remove resource iqn.2010-10.org.openstack:efa19602-89a1-45de-bb87-b01c39979326 because of JDSS resource iqn.2010-10.org.openstack:efa19602-89a1-45de-bb87-b01c39979326 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] deleating volume v_efa19602-89a1-45de-bb87-b01c39979326 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] get snapshots for volume v_efa19602-89a1-45de-bb87-b01c39979326 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_efa19602-89a1-45de-bb87-b01c39979326/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_efa19602-89a1-45de-bb87-b01c39979326/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_efa19602-89a1-45de-bb87-b01c39979326/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] get volume v_efa19602-89a1-45de-bb87-b01c39979326 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_efa19602-89a1-45de-bb87-b01c39979326 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_efa19602-89a1-45de-bb87-b01c39979326 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_efa19602-89a1-45de-bb87-b01c39979326', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443547', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113516', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10679541718151506820', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '562e9e6e84941d0d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265640960', 'san:volume_id': '562e9e6e84941d0d96952e83327780eb22453985', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84845', 'name': 'v_efa19602-89a1-45de-bb87-b01c39979326', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_efa19602-89a1-45de-bb87-b01c39979326 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] delete volume:v_efa19602-89a1-45de-bb87-b01c39979326 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_efa19602-89a1-45de-bb87-b01c39979326 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_efa19602-89a1-45de-bb87-b01c39979326 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-841070a3-6c4e-44e1-9802-b5e49847370e req-d51179fc-79f0-464f-a87f-83aed944f07d tempest-TestVolumeBootPattern-910285030 None] terminate connection for c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:15:46 user cinder-volume[73403]: INFO cinder.volume.manager [req-841070a3-6c4e-44e1-9802-b5e49847370e req-d51179fc-79f0-464f-a87f-83aed944f07d tempest-TestVolumeBootPattern-910285030 None] Terminate volume connection completed successfully. Apr 14 03:15:46 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-841070a3-6c4e-44e1-9802-b5e49847370e req-d51179fc-79f0-464f-a87f-83aed944f07d tempest-TestVolumeBootPattern-910285030 None] Deleting attachment 3f82a8e5-bedd-4384-b5b2-6a269185f6a0. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:15:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-841070a3-6c4e-44e1-9802-b5e49847370e req-d51179fc-79f0-464f-a87f-83aed944f07d tempest-TestVolumeBootPattern-910285030 None] remove_export for volume: c6fbfee2-70fa-477a-a761-8d092061e691. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:15:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-841070a3-6c4e-44e1-9802-b5e49847370e req-d51179fc-79f0-464f-a87f-83aed944f07d tempest-TestVolumeBootPattern-910285030 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:15:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-841070a3-6c4e-44e1-9802-b5e49847370e req-d51179fc-79f0-464f-a87f-83aed944f07d tempest-TestVolumeBootPattern-910285030 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1818179131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c6fbfee2-70fa-477a-a761-8d092061e691,launched_at=2023-04-14T03:08:04Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='2d2e49e8e92e416faebf55e3d4e0e087',provider_auth='CHAP tekamKoO sDhWrA2PuO1ceX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:08:01Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:10:56Z,use_quota=True,user_id='60e11b7ab2914209b23bf7a53791da64',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:15:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-841070a3-6c4e-44e1-9802-b5e49847370e req-d51179fc-79f0-464f-a87f-83aed944f07d tempest-TestVolumeBootPattern-910285030 None] detach volume v_c6fbfee2-70fa-477a-a761-8d092061e691 from target iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:15:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-841070a3-6c4e-44e1-9802-b5e49847370e req-d51179fc-79f0-464f-a87f-83aed944f07d tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/luns/v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-841070a3-6c4e-44e1-9802-b5e49847370e req-d51179fc-79f0-464f-a87f-83aed944f07d tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/luns/v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ebb26fd-e063-4c35-bd7d-66debe8e926b tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_341ddf1e-6211-421f-93dd-c1b4599e2085'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ebb26fd-e063-4c35-bd7d-66debe8e926b tempest-SnapshotDataIntegrityTests-450991924 None] create volume s_341ddf1e-6211-421f-93dd-c1b4599e2085 from snapshot s_341ddf1e-6211-421f-93dd-c1b4599e2085 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:15:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ebb26fd-e063-4c35-bd7d-66debe8e926b tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ebb26fd-e063-4c35-bd7d-66debe8e926b tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ebb26fd-e063-4c35-bd7d-66debe8e926b tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e@s_341ddf1e-6211-421f-93dd-c1b4599e2085', 'is_clone': True, 'full_name': 'Pool-0/s_341ddf1e-6211-421f-93dd-c1b4599e2085', 'name': 's_341ddf1e-6211-421f-93dd-c1b4599e2085'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ebb26fd-e063-4c35-bd7d-66debe8e926b tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_341ddf1e-6211-421f-93dd-c1b4599e2085/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ebb26fd-e063-4c35-bd7d-66debe8e926b tempest-SnapshotDataIntegrityTests-450991924 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_341ddf1e-6211-421f-93dd-c1b4599e2085/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ebb26fd-e063-4c35-bd7d-66debe8e926b tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_341ddf1e-6211-421f-93dd-c1b4599e2085/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ebb26fd-e063-4c35-bd7d-66debe8e926b tempest-SnapshotDataIntegrityTests-450991924 None] volume s_341ddf1e-6211-421f-93dd-c1b4599e2085 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:15:47 user cinder-volume[73403]: INFO cinder.volume.manager [None req-4ebb26fd-e063-4c35-bd7d-66debe8e926b tempest-SnapshotDataIntegrityTests-450991924 None] Create snapshot completed successfully Apr 14 03:15:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_efa19602-89a1-45de-bb87-b01c39979326 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] volume v_efa19602-89a1-45de-bb87-b01c39979326 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:15:47 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=57,cinder:UPDATE=34,cinder:DELETE=4,cinder:INSERT=5 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:15:47 user cinder-volume[73403]: DEBUG cinder.quota [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Created reservations ['080c0534-a384-4080-957a-d56fa468be14', '8b174117-43f4-482a-a396-2b2450139b61', '7315813e-391d-4817-81f5-aa570df5da7d', 'e138fc4a-9ed6-4fd8-8b30-3c610de14582'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:15:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:15:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:15:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Acquiring lock "cinder-56dc5690-26ec-440a-aee9-99166159e67b-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Lock "cinder-56dc5690-26ec-440a-aee9-99166159e67b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] remove_export for volume: 56dc5690-26ec-440a-aee9-99166159e67b. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-424816728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=56dc5690-26ec-440a-aee9-99166159e67b,launched_at=2023-04-14T03:15:39Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cacf79308fe4bab8e28479c9bbc26ab',provider_auth='CHAP dkPcbIhL CvQayMx0qPJB81',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:56dc5690-26ec-440a-aee9-99166159e67b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:38Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:15:48Z,updated_at=2023-04-14T03:15:48Z,use_quota=True,user_id='acb0a910c48d48d29c164289b2d26333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:56dc5690-26ec-440a-aee9-99166159e67b. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] detach volume v_56dc5690-26ec-440a-aee9-99166159e67b from target iqn.2010-10.org.openstack:56dc5690-26ec-440a-aee9-99166159e67b {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:56dc5690-26ec-440a-aee9-99166159e67b/luns/v_56dc5690-26ec-440a-aee9-99166159e67b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:56dc5690-26ec-440a-aee9-99166159e67b/luns/v_56dc5690-26ec-440a-aee9-99166159e67b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:56dc5690-26ec-440a-aee9-99166159e67b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:56dc5690-26ec-440a-aee9-99166159e67b/luns/v_56dc5690-26ec-440a-aee9-99166159e67b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:56dc5690-26ec-440a-aee9-99166159e67b/luns/v_56dc5690-26ec-440a-aee9-99166159e67b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] failed to remove resource iqn.2010-10.org.openstack:56dc5690-26ec-440a-aee9-99166159e67b because of JDSS resource v_56dc5690-26ec-440a-aee9-99166159e67b DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] delete target: iqn.2010-10.org.openstack:56dc5690-26ec-440a-aee9-99166159e67b {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] delete target iqn.2010-10.org.openstack:56dc5690-26ec-440a-aee9-99166159e67b {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:56dc5690-26ec-440a-aee9-99166159e67b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:56dc5690-26ec-440a-aee9-99166159e67b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-841070a3-6c4e-44e1-9802-b5e49847370e req-d51179fc-79f0-464f-a87f-83aed944f07d tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/luns/v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-841070a3-6c4e-44e1-9802-b5e49847370e req-d51179fc-79f0-464f-a87f-83aed944f07d tempest-TestVolumeBootPattern-910285030 None] delete target: iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-841070a3-6c4e-44e1-9802-b5e49847370e req-d51179fc-79f0-464f-a87f-83aed944f07d tempest-TestVolumeBootPattern-910285030 None] delete target iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-841070a3-6c4e-44e1-9802-b5e49847370e req-d51179fc-79f0-464f-a87f-83aed944f07d tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-841070a3-6c4e-44e1-9802-b5e49847370e req-d51179fc-79f0-464f-a87f-83aed944f07d tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:56dc5690-26ec-440a-aee9-99166159e67b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:56dc5690-26ec-440a-aee9-99166159e67b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:56dc5690-26ec-440a-aee9-99166159e67b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] failed to remove resource iqn.2010-10.org.openstack:56dc5690-26ec-440a-aee9-99166159e67b because of JDSS resource iqn.2010-10.org.openstack:56dc5690-26ec-440a-aee9-99166159e67b DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] deleating volume v_56dc5690-26ec-440a-aee9-99166159e67b {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] get snapshots for volume v_56dc5690-26ec-440a-aee9-99166159e67b {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_56dc5690-26ec-440a-aee9-99166159e67b/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_56dc5690-26ec-440a-aee9-99166159e67b/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb87e3b2-54b3-496d-bb48-9470bbf3905c tempest-SnapshotDataIntegrityTests-450991924 None] create snapshot 75429595-9885-4fac-9e0d-9e64e0e61a0c for volume d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bb87e3b2-54b3-496d-bb48-9470bbf3905c tempest-SnapshotDataIntegrityTests-450991924 None] cloning v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e to s_75429595-9885-4fac-9e0d-9e64e0e61a0c {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb87e3b2-54b3-496d-bb48-9470bbf3905c tempest-SnapshotDataIntegrityTests-450991924 None] create snapshot s_75429595-9885-4fac-9e0d-9e64e0e61a0c {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb87e3b2-54b3-496d-bb48-9470bbf3905c tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb87e3b2-54b3-496d-bb48-9470bbf3905c tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_56dc5690-26ec-440a-aee9-99166159e67b/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] get volume v_56dc5690-26ec-440a-aee9-99166159e67b info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_56dc5690-26ec-440a-aee9-99166159e67b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_56dc5690-26ec-440a-aee9-99166159e67b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_56dc5690-26ec-440a-aee9-99166159e67b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443547', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113517', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6156560163805937029', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '93853a699bda1209', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265358336', 'san:volume_id': '93853a699bda1209b65b55d5d3cb19960d16e56e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84852', 'name': 'v_56dc5690-26ec-440a-aee9-99166159e67b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_56dc5690-26ec-440a-aee9-99166159e67b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] delete volume:v_56dc5690-26ec-440a-aee9-99166159e67b recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_56dc5690-26ec-440a-aee9-99166159e67b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_56dc5690-26ec-440a-aee9-99166159e67b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 200, 'error': None, 'data': {'available': '114265690112', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:15:49 user cinder-volume[73403]: DEBUG cinder.manager [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:15:49 user cinder-volume[73403]: INFO cinder.volume.manager [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Deleted volume successfully. Apr 14 03:15:49 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b54142ad-fa35-46df-8e68-ae10fa13b16c tempest-CreateVolumesFromImageTest-1520597783 None] Lock "cinder-efa19602-89a1-45de-bb87-b01c39979326-delete_volume" released by "delete_volume" :: held 4.221s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:15:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-841070a3-6c4e-44e1-9802-b5e49847370e req-d51179fc-79f0-464f-a87f-83aed944f07d tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-841070a3-6c4e-44e1-9802-b5e49847370e req-d51179fc-79f0-464f-a87f-83aed944f07d tempest-TestVolumeBootPattern-910285030 None] target iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:15:50 user cinder-volume[73403]: INFO cinder.volume.manager [None req-cc7aa9d6-d4a2-47b1-b18a-ee79b7a4c6b8 tempest-GroupSnapshotsTest-1003911629 None] Group tempest-GroupSnapshotsTest-Group-1682978409: creating Apr 14 03:15:50 user cinder-volume[73403]: INFO cinder.volume.manager [None req-cc7aa9d6-d4a2-47b1-b18a-ee79b7a4c6b8 tempest-GroupSnapshotsTest-1003911629 None] Group tempest-GroupSnapshotsTest-Group-1682978409: created successfully Apr 14 03:15:50 user cinder-volume[73403]: INFO cinder.volume.manager [None req-cc7aa9d6-d4a2-47b1-b18a-ee79b7a4c6b8 tempest-GroupSnapshotsTest-1003911629 None] Create group completed successfully. Apr 14 03:15:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb87e3b2-54b3-496d-bb48-9470bbf3905c tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_75429595-9885-4fac-9e0d-9e64e0e61a0c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb87e3b2-54b3-496d-bb48-9470bbf3905c tempest-SnapshotDataIntegrityTests-450991924 None] create volume s_75429595-9885-4fac-9e0d-9e64e0e61a0c from snapshot s_75429595-9885-4fac-9e0d-9e64e0e61a0c {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:15:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb87e3b2-54b3-496d-bb48-9470bbf3905c tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb87e3b2-54b3-496d-bb48-9470bbf3905c tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_56dc5690-26ec-440a-aee9-99166159e67b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] volume v_56dc5690-26ec-440a-aee9-99166159e67b deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:15:50 user cinder-volume[73403]: DEBUG cinder.quota [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Created reservations ['3d523f3c-8ee3-4bbb-afd7-95ab8fab1bbc', 'e588f896-8db3-4632-bf02-f29810832014', '2000f546-1f27-477d-a698-215c3fa29dc3', '3f713e1a-bfb8-4359-977c-863bd4a59be4'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:15:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:15:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:15:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb87e3b2-54b3-496d-bb48-9470bbf3905c tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e@s_75429595-9885-4fac-9e0d-9e64e0e61a0c', 'is_clone': True, 'full_name': 'Pool-0/s_75429595-9885-4fac-9e0d-9e64e0e61a0c', 'name': 's_75429595-9885-4fac-9e0d-9e64e0e61a0c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb87e3b2-54b3-496d-bb48-9470bbf3905c tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_75429595-9885-4fac-9e0d-9e64e0e61a0c/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb87e3b2-54b3-496d-bb48-9470bbf3905c tempest-SnapshotDataIntegrityTests-450991924 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_75429595-9885-4fac-9e0d-9e64e0e61a0c/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bb87e3b2-54b3-496d-bb48-9470bbf3905c tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_75429595-9885-4fac-9e0d-9e64e0e61a0c/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bb87e3b2-54b3-496d-bb48-9470bbf3905c tempest-SnapshotDataIntegrityTests-450991924 None] volume s_75429595-9885-4fac-9e0d-9e64e0e61a0c properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:15:51 user cinder-volume[73403]: INFO cinder.volume.manager [None req-bb87e3b2-54b3-496d-bb48-9470bbf3905c tempest-SnapshotDataIntegrityTests-450991924 None] Create snapshot completed successfully Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 200, 'error': None, 'data': {'available': '114265370624', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.manager [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:15:51 user cinder-volume[73403]: INFO cinder.volume.manager [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Deleted volume successfully. Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Acquiring lock "cinder-81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f91b8aeb-fde1-49a2-a2a3-00e04d6a32c0 tempest-CreateVolumesFromImageTest-1520597783 None] Lock "cinder-56dc5690-26ec-440a-aee9-99166159e67b-delete_volume" released by "delete_volume" :: held 3.265s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Lock "cinder-81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.driver [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] copy_volume_to_image volume-117adce3-717a-4664-8cfa-be7d1f5d0169. {{(pid=73403) copy_volume_to_image /opt/stack/cinder/cinder/volume/driver.py:930}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG os_brick.utils [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=73403) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cef2f80-0b02-4fe2-a789-29ab367e6363]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e1198c5ebb57\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] remove_export for volume: 81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1968576305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f,launched_at=2023-04-14T03:15:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cacf79308fe4bab8e28479c9bbc26ab',provider_auth='CHAP wTNHsYIU fWlXimgdDFyrt0',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:37Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:15:51Z,updated_at=2023-04-14T03:15:51Z,use_quota=True,user_id='acb0a910c48d48d29c164289b2d26333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] detach volume v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f from target iqn.2010-10.org.openstack:81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f/luns/v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f/luns/v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0b08b3-f62d-4ce4-ab1e-d3dec0caaa5e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Flow 'volume_create_manager' (a2b97008-2c3f-4ca8-a6f6-37c99c530fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05368ec7-01b2-41c2-84ff-68ef3f719903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f/luns/v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f/luns/v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] failed to remove resource iqn.2010-10.org.openstack:81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f because of JDSS resource v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] delete target: iqn.2010-10.org.openstack:81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] delete target iqn.2010-10.org.openstack:81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a3d0ee-cee9-4925-8aa4-fe63fe7b0ce0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88b306e-9772-4b95-951d-f328fd0e926f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Running cmd (subprocess): nvme version {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] 'nvme version' failed. Not Retrying. {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] failed to remove resource iqn.2010-10.org.openstack:81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f because of JDSS resource iqn.2010-10.org.openstack:81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] deleating volume v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] get snapshots for volume v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.nvmeof [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] nvme not present on system {{(pid=73403) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05368ec7-01b2-41c2-84ff-68ef3f719903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1914582324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ad8c1321-4787-4ad0-8d16-a5526f485816,host='user@joviandss-2#joviandss-2',id=07b62be3-201e-48e1-b5bd-8bb3395469e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0d5639765ed45e9b679f038a2775982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:15:52Z,use_quota=True,user_id='177ee2ef30a24897a01a934cd31c755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fe10fc-1669-4bbb-8bd2-b2ff0b881ebe),volume_type_id=10fe10fc-1669-4bbb-8bd2-b2ff0b881ebe)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e662c12c-0c75-4b04-86df-98b446e34159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e662c12c-0c75-4b04-86df-98b446e34159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f8bba9-6978-4d3e-9434-bc46c370bdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f8bba9-6978-4d3e-9434-bc46c370bdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07b62be3-201e-48e1-b5bd-8bb3395469e9', 'volume_name': 'volume-07b62be3-201e-48e1-b5bd-8bb3395469e9', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (737b4e06-00a6-4447-890f-d536e5eb5163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (737b4e06-00a6-4447-890f-d536e5eb5163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a84047c-9e9f-4fec-a431-87e19ef2bd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:51 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Volume 07b62be3-201e-48e1-b5bd-8bb3395469e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07b62be3-201e-48e1-b5bd-8bb3395469e9', 'volume_size': 1} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] creating volume v_07b62be3-201e-48e1-b5bd-8bb3395469e9. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] create volume {'name': 'v_07b62be3-201e-48e1-b5bd-8bb3395469e9', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 03:15:51 user cinder-volume[73403]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Apr 14 03:15:51 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[852b8247-0307-4e59-b602-ce44e047a6f1]: (4, '') {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.lightos [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73403) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.lightos [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73403) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.lightos [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] LIGHTOS: no hostnqn found. {{(pid=73403) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG os_brick.utils [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e1198c5ebb57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73403) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.driver [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Volume 117adce3-717a-4664-8cfa-be7d1f5d0169: creating export {{(pid=73403) _attach_volume /opt/stack/cinder/cinder/volume/driver.py:1051}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] create export for volume: 117adce3-717a-4664-8cfa-be7d1f5d0169. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] ensure volume 117adce3-717a-4664-8cfa-be7d1f5d0169 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] check if targe iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] create target and attach volume 117adce3-717a-4664-8cfa-be7d1f5d0169 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] create target iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] get volume v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443547', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113511', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14267184026245223034', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a1002342e3f982b0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265210880', 'san:volume_id': 'a1002342e3f982b09ca65d09fe82e1591ee3e16b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86412', 'name': 'v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] delete volume:v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b43e936-d79a-46a0-8575-00ed2b13733c tempest-SnapshotDataIntegrityTests-450991924 None] create snapshot 7d46d1ed-8a23-45a2-ac5f-405e5afd0b17 for volume d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b43e936-d79a-46a0-8575-00ed2b13733c tempest-SnapshotDataIntegrityTests-450991924 None] cloning v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e to s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b43e936-d79a-46a0-8575-00ed2b13733c tempest-SnapshotDataIntegrityTests-450991924 None] create snapshot s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b43e936-d79a-46a0-8575-00ed2b13733c tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b43e936-d79a-46a0-8575-00ed2b13733c tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_07b62be3-201e-48e1-b5bd-8bb3395469e9', 'is_clone': False, 'name': 'v_07b62be3-201e-48e1-b5bd-8bb3395469e9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a84047c-9e9f-4fec-a431-87e19ef2bd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07b62be3-201e-48e1-b5bd-8bb3395469e9', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a7ccb43-10ab-44c4-be48-91fbb44e2f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:15:52 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Volume volume-07b62be3-201e-48e1-b5bd-8bb3395469e9 (07b62be3-201e-48e1-b5bd-8bb3395469e9): created successfully Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a7ccb43-10ab-44c4-be48-91fbb44e2f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Flow 'volume_create_manager' (a2b97008-2c3f-4ca8-a6f6-37c99c530fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:15:52 user cinder-volume[73403]: INFO cinder.volume.manager [None req-f329bcbe-4327-42ee-a079-aa46452cedf1 tempest-GroupSnapshotsTest-1003911629 None] Created volume successfully. Apr 14 03:15:52 user cinder-volume[73403]: INFO cinder.volume.manager [None req-fa6f1d03-5b0c-4638-a5f6-a2f899b8110d tempest-GroupSnapshotsTest-1003911629 None] GroupSnapshot 4a48943b-4198-4a77-ab19-a2a0712c0dfe: creating. Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-fa6f1d03-5b0c-4638-a5f6-a2f899b8110d tempest-GroupSnapshotsTest-1003911629 None] Group snapshot 4a48943b-4198-4a77-ab19-a2a0712c0dfe: creating. {{(pid=73403) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4129}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fa6f1d03-5b0c-4638-a5f6-a2f899b8110d tempest-GroupSnapshotsTest-1003911629 None] create snapshot 56bf979e-e582-4b65-a641-e67f199f7b62 for volume 07b62be3-201e-48e1-b5bd-8bb3395469e9 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fa6f1d03-5b0c-4638-a5f6-a2f899b8110d tempest-GroupSnapshotsTest-1003911629 None] cloning v_07b62be3-201e-48e1-b5bd-8bb3395469e9 to s_56bf979e-e582-4b65-a641-e67f199f7b62 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa6f1d03-5b0c-4638-a5f6-a2f899b8110d tempest-GroupSnapshotsTest-1003911629 None] create snapshot s_56bf979e-e582-4b65-a641-e67f199f7b62 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa6f1d03-5b0c-4638-a5f6-a2f899b8110d tempest-GroupSnapshotsTest-1003911629 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07b62be3-201e-48e1-b5bd-8bb3395469e9/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa6f1d03-5b0c-4638-a5f6-a2f899b8110d tempest-GroupSnapshotsTest-1003911629 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07b62be3-201e-48e1-b5bd-8bb3395469e9/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] volume v_81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=68,cinder:UPDATE=24,cinder:DELETE=2,cinder:INSERT=6 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.quota [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Created reservations ['cba0d28b-a1c6-4055-a1a2-e46c4291189b', '92fc0398-7ec9-4e6b-ad2c-1a1c7fb15ca0', '9422a623-4a3f-4818-ba37-ab6b4f835057', '133520d3-c692-48f0-8988-eb76ed306ff5'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa6f1d03-5b0c-4638-a5f6-a2f899b8110d tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_56bf979e-e582-4b65-a641-e67f199f7b62'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07b62be3-201e-48e1-b5bd-8bb3395469e9/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa6f1d03-5b0c-4638-a5f6-a2f899b8110d tempest-GroupSnapshotsTest-1003911629 None] create volume s_56bf979e-e582-4b65-a641-e67f199f7b62 from snapshot s_56bf979e-e582-4b65-a641-e67f199f7b62 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa6f1d03-5b0c-4638-a5f6-a2f899b8110d tempest-GroupSnapshotsTest-1003911629 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07b62be3-201e-48e1-b5bd-8bb3395469e9/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa6f1d03-5b0c-4638-a5f6-a2f899b8110d tempest-GroupSnapshotsTest-1003911629 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07b62be3-201e-48e1-b5bd-8bb3395469e9/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] atach volume v_117adce3-717a-4664-8cfa-be7d1f5d0169 to target iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.coordination [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Acquiring lock "cinder-a70edf93-9f37-4097-9642-ed1fc4802294-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 200, 'error': None, 'data': {'available': '114265079808', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.manager [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:15:54 user cinder-volume[73403]: INFO cinder.volume.manager [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Deleted volume successfully. Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.coordination [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Lock "cinder-a70edf93-9f37-4097-9642-ed1fc4802294-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5a854a68-8843-4c52-9977-294ea6d6b5c0 tempest-CreateVolumesFromImageTest-1520597783 None] Lock "cinder-81a1f90c-a2a4-49e6-ab9c-d7b56c3ca25f-delete_volume" released by "delete_volume" :: held 3.322s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] remove_export for volume: a70edf93-9f37-4097-9642-ed1fc4802294. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1100969330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a70edf93-9f37-4097-9642-ed1fc4802294,launched_at=2023-04-14T03:15:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cacf79308fe4bab8e28479c9bbc26ab',provider_auth='CHAP AywCrXEZ Qn341OSMyxBhUo',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a70edf93-9f37-4097-9642-ed1fc4802294 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:37Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:15:55Z,updated_at=2023-04-14T03:15:55Z,use_quota=True,user_id='acb0a910c48d48d29c164289b2d26333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:a70edf93-9f37-4097-9642-ed1fc4802294. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] detach volume v_a70edf93-9f37-4097-9642-ed1fc4802294 from target iqn.2010-10.org.openstack:a70edf93-9f37-4097-9642-ed1fc4802294 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a70edf93-9f37-4097-9642-ed1fc4802294/luns/v_a70edf93-9f37-4097-9642-ed1fc4802294 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a70edf93-9f37-4097-9642-ed1fc4802294/luns/v_a70edf93-9f37-4097-9642-ed1fc4802294 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a70edf93-9f37-4097-9642-ed1fc4802294 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a70edf93-9f37-4097-9642-ed1fc4802294/luns/v_a70edf93-9f37-4097-9642-ed1fc4802294'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a70edf93-9f37-4097-9642-ed1fc4802294/luns/v_a70edf93-9f37-4097-9642-ed1fc4802294 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] failed to remove resource iqn.2010-10.org.openstack:a70edf93-9f37-4097-9642-ed1fc4802294 because of JDSS resource v_a70edf93-9f37-4097-9642-ed1fc4802294 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] delete target: iqn.2010-10.org.openstack:a70edf93-9f37-4097-9642-ed1fc4802294 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] delete target iqn.2010-10.org.openstack:a70edf93-9f37-4097-9642-ed1fc4802294 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a70edf93-9f37-4097-9642-ed1fc4802294 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a70edf93-9f37-4097-9642-ed1fc4802294 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a70edf93-9f37-4097-9642-ed1fc4802294 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a70edf93-9f37-4097-9642-ed1fc4802294'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a70edf93-9f37-4097-9642-ed1fc4802294 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] failed to remove resource iqn.2010-10.org.openstack:a70edf93-9f37-4097-9642-ed1fc4802294 because of JDSS resource iqn.2010-10.org.openstack:a70edf93-9f37-4097-9642-ed1fc4802294 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] deleating volume v_a70edf93-9f37-4097-9642-ed1fc4802294 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] get snapshots for volume v_a70edf93-9f37-4097-9642-ed1fc4802294 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a70edf93-9f37-4097-9642-ed1fc4802294/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a70edf93-9f37-4097-9642-ed1fc4802294/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa6f1d03-5b0c-4638-a5f6-a2f899b8110d tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_07b62be3-201e-48e1-b5bd-8bb3395469e9@s_56bf979e-e582-4b65-a641-e67f199f7b62', 'is_clone': True, 'full_name': 'Pool-0/s_56bf979e-e582-4b65-a641-e67f199f7b62', 'name': 's_56bf979e-e582-4b65-a641-e67f199f7b62'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07b62be3-201e-48e1-b5bd-8bb3395469e9/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa6f1d03-5b0c-4638-a5f6-a2f899b8110d tempest-GroupSnapshotsTest-1003911629 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_56bf979e-e582-4b65-a641-e67f199f7b62/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa6f1d03-5b0c-4638-a5f6-a2f899b8110d tempest-GroupSnapshotsTest-1003911629 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_56bf979e-e582-4b65-a641-e67f199f7b62/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa6f1d03-5b0c-4638-a5f6-a2f899b8110d tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_56bf979e-e582-4b65-a641-e67f199f7b62/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa6f1d03-5b0c-4638-a5f6-a2f899b8110d tempest-GroupSnapshotsTest-1003911629 None] volume s_56bf979e-e582-4b65-a641-e67f199f7b62 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:15:55 user cinder-volume[73403]: INFO cinder.volume.manager [None req-fa6f1d03-5b0c-4638-a5f6-a2f899b8110d tempest-GroupSnapshotsTest-1003911629 None] group_snapshot 4a48943b-4198-4a77-ab19-a2a0712c0dfe: created successfully Apr 14 03:15:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a70edf93-9f37-4097-9642-ed1fc4802294/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] get volume v_a70edf93-9f37-4097-9642-ed1fc4802294 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:15:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a70edf93-9f37-4097-9642-ed1fc4802294 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a70edf93-9f37-4097-9642-ed1fc4802294 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a70edf93-9f37-4097-9642-ed1fc4802294', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443546', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113508', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1525393967426255393', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '88d165ef0615eeec', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265055232', 'san:volume_id': '88d165ef0615eeecbeb753ffdcf984acd7763f9d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86675', 'name': 'v_a70edf93-9f37-4097-9642-ed1fc4802294', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a70edf93-9f37-4097-9642-ed1fc4802294 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] delete volume:v_a70edf93-9f37-4097-9642-ed1fc4802294 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:15:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a70edf93-9f37-4097-9642-ed1fc4802294 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a70edf93-9f37-4097-9642-ed1fc4802294 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b43e936-d79a-46a0-8575-00ed2b13733c tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b43e936-d79a-46a0-8575-00ed2b13733c tempest-SnapshotDataIntegrityTests-450991924 None] create volume s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17 from snapshot s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:15:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b43e936-d79a-46a0-8575-00ed2b13733c tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b43e936-d79a-46a0-8575-00ed2b13733c tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84f4a164-ae84-45fa-8d0b-bce65720c5b1 tempest-GroupSnapshotsTest-1003911629 None] create volume 1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 from snapshot 56bf979e-e582-4b65-a641-e67f199f7b62 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 03:15:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84f4a164-ae84-45fa-8d0b-bce65720c5b1 tempest-GroupSnapshotsTest-1003911629 None] cloning s_56bf979e-e582-4b65-a641-e67f199f7b62 to v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:15:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84f4a164-ae84-45fa-8d0b-bce65720c5b1 tempest-GroupSnapshotsTest-1003911629 None] create snapshot v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:15:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84f4a164-ae84-45fa-8d0b-bce65720c5b1 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_56bf979e-e582-4b65-a641-e67f199f7b62/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84f4a164-ae84-45fa-8d0b-bce65720c5b1 tempest-GroupSnapshotsTest-1003911629 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_56bf979e-e582-4b65-a641-e67f199f7b62/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6263393562393561', 'lun': 0, 'mode': 'wt', 'name': 'v_117adce3-717a-4664-8cfa-be7d1f5d0169', 'prod_id': 'Storage', 'scsi_id': 'bc95b95a35dca7fa'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] add credentails to target iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:15:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a70edf93-9f37-4097-9642-ed1fc4802294 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] volume v_a70edf93-9f37-4097-9642-ed1fc4802294 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:15:57 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=29,cinder:SELECT=60,cinder:DELETE=4,cinder:INSERT=7 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:15:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84f4a164-ae84-45fa-8d0b-bce65720c5b1 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_56bf979e-e582-4b65-a641-e67f199f7b62/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84f4a164-ae84-45fa-8d0b-bce65720c5b1 tempest-GroupSnapshotsTest-1003911629 None] create volume v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 from snapshot v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:15:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84f4a164-ae84-45fa-8d0b-bce65720c5b1 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_56bf979e-e582-4b65-a641-e67f199f7b62/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84f4a164-ae84-45fa-8d0b-bce65720c5b1 tempest-GroupSnapshotsTest-1003911629 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_56bf979e-e582-4b65-a641-e67f199f7b62/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:57 user cinder-volume[73403]: DEBUG cinder.quota [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Created reservations ['1b7225b2-6c48-47d8-b0d4-69a66b487413', 'c4288744-911e-406c-8b85-db5c5f6e0054', 'a9c79d46-679a-48b7-b593-3551a388828f', '4ddbcef0-78b6-4347-97b3-b8ce09085b4f'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:15:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:15:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:15:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Geting {'code': 200, 'error': None, 'data': {'available': '114265067520', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG cinder.manager [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:15:58 user cinder-volume[73403]: INFO cinder.volume.manager [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Deleted volume successfully. Apr 14 03:15:58 user cinder-volume[73403]: DEBUG cinder.coordination [None req-498ac364-e630-49eb-9e22-865cc0d7f2e2 tempest-CreateVolumesFromImageTest-1520597783 None] Lock "cinder-a70edf93-9f37-4097-9642-ed1fc4802294-delete_volume" released by "delete_volume" :: held 3.619s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b43e936-d79a-46a0-8575-00ed2b13733c tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e@s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17', 'is_clone': True, 'full_name': 'Pool-0/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17', 'name': 's_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b43e936-d79a-46a0-8575-00ed2b13733c tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b43e936-d79a-46a0-8575-00ed2b13733c tempest-SnapshotDataIntegrityTests-450991924 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84f4a164-ae84-45fa-8d0b-bce65720c5b1 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_56bf979e-e582-4b65-a641-e67f199f7b62@v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668', 'is_clone': True, 'full_name': 'Pool-0/v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668', 'name': 'v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_56bf979e-e582-4b65-a641-e67f199f7b62/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84f4a164-ae84-45fa-8d0b-bce65720c5b1 tempest-GroupSnapshotsTest-1003911629 None] get volume v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84f4a164-ae84-45fa-8d0b-bce65720c5b1 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84f4a164-ae84-45fa-8d0b-bce65720c5b1 tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Geting {'code': 201, 'error': None, 'data': {'name': 'jOXbqBQa'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] initialize_connection for 117adce3-717a-4664-8cfa-be7d1f5d0169 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connector [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Factory for iscsi on None {{(pid=73403) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jOXbqBQa', 'auth_password': '***', 'target_lun': False}}" {{(pid=73403) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 03:15:58 user cinder-volume[73403]: INFO os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Trying to connect to iSCSI portal 172.16.0.220:3260 Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84f4a164-ae84-45fa-8d0b-bce65720c5b1 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_56bf979e-e582-4b65-a641-e67f199f7b62@v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443566', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113579', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13111990297540597475', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '647dc3842ea31140', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265067520', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85354', 'name': 'v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f849f2-fb64-497b-9e95-206649e17374]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Apr 14 03:15:58 user cinder-volume[73403]: {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 --interface default --op new {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[07363d84-d581-497c-8792-dd23602a4047]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169] added\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169] added Apr 14 03:15:58 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f06b8a7-5ba3-438a-a28d-eae5768764f4]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:15:58 user cinder-volume[73403]: INFO cinder.volume.manager [None req-84f4a164-ae84-45fa-8d0b-bce65720c5b1 tempest-GroupSnapshotsTest-1003911629 None] Create group from source-snapshot-4a48943b-4198-4a77-ab19-a2a0712c0dfe completed successfully. Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c276b4-1ce8-448e-9597-22034182faed]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jOXbqBQa {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jOXbqBQa" returned: 0 in 0.022s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54ba316-133c-4bf5-9f73-293a046b185c]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jOXbqBQa'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b43e936-d79a-46a0-8575-00ed2b13733c tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b43e936-d79a-46a0-8575-00ed2b13733c tempest-SnapshotDataIntegrityTests-450991924 None] volume s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcdcb07-3e60-42c1-9ee3-07b0ad83d58a]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:15:58 user cinder-volume[73403]: INFO cinder.volume.manager [None req-5b43e936-d79a-46a0-8575-00ed2b13733c tempest-SnapshotDataIntegrityTests-450991924 None] Create snapshot completed successfully Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dedf5af-8c02-44c8-8b08-e61e29de8478]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e (non-flash)\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c (non-flash) Apr 14 03:15:58 user cinder-volume[73403]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff (non-flash) Apr 14 03:15:58 user cinder-volume[73403]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab (non-flash) Apr 14 03:15:58 user cinder-volume[73403]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e (non-flash) Apr 14 03:15:58 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c (non-flash) Apr 14 03:15:58 user cinder-volume[73403]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff (non-flash) Apr 14 03:15:58 user cinder-volume[73403]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab (non-flash) Apr 14 03:15:58 user cinder-volume[73403]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e (non-flash) Apr 14 03:15:58 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 --login {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[28857e55-6012-4898-a93f-d3274baaadfe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169, portal: 172.16.0.220,3260] Apr 14 03:15:58 user cinder-volume[73403]: Login to [iface: default, target: iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169, portal: 172.16.0.220,3260] successful. Apr 14 03:15:58 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4684029-954e-4326-b56d-3cac2d5199e1]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[597caf79-ded2-4e98-8d57-2877a9c797db]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 (non-flash)\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c (non-flash) Apr 14 03:15:58 user cinder-volume[73403]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff (non-flash) Apr 14 03:15:58 user cinder-volume[73403]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab (non-flash) Apr 14 03:15:58 user cinder-volume[73403]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e (non-flash) Apr 14 03:15:58 user cinder-volume[73403]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 (non-flash) Apr 14 03:15:58 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c (non-flash) Apr 14 03:15:58 user cinder-volume[73403]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff (non-flash) Apr 14 03:15:58 user cinder-volume[73403]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab (non-flash) Apr 14 03:15:58 user cinder-volume[73403]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e (non-flash) Apr 14 03:15:58 user cinder-volume[73403]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 (non-flash) Apr 14 03:15:58 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Connected to 172.16.0.220:3260 {{(pid=73403) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=73403) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Scanning host 34 c: -, t: -, l: 0) {{(pid=73403) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b4b99e-5e3d-40c2-afaa-752a948ba3b1]: (4, ('- - 0', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73403) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}} Apr 14 03:15:58 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jOXbqBQa', 'auth_password': '***', 'target_lun': False} {{(pid=73403) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] remove_export for volume: 1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a0b22b8-80c9-4b28-b2b1-e44eddccbb00,host='user@joviandss-2#joviandss-2',id=1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0d5639765ed45e9b679f038a2775982',provider_auth='CHAP ZGuDUxOh iVecHLYpDwaEU5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=None,service_uuid=None,shared_targets=True,size=1,snapshot_id=56bf979e-e582-4b65-a641-e67f199f7b62,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T03:15:59Z,use_quota=True,user_id='177ee2ef30a24897a01a934cd31c755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fe10fc-1669-4bbb-8bd2-b2ff0b881ebe),volume_type_id=10fe10fc-1669-4bbb-8bd2-b2ff0b881ebe) from target:iqn.2010-10.org.openstack:1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] detach volume v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 from target iqn.2010-10.org.openstack:1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668/luns/v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668/luns/v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668/luns/v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668/luns/v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] failed to remove resource iqn.2010-10.org.openstack:1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 because of JDSS resource v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] delete target: iqn.2010-10.org.openstack:1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] delete target iqn.2010-10.org.openstack:1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] failed to remove resource iqn.2010-10.org.openstack:1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 because of JDSS resource iqn.2010-10.org.openstack:1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] deleating volume v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] get snapshots for volume v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26263393562393561', 'path': '/dev/sdc'} {{(pid=73403) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 03:15:59 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): dd if=/dev/sdc of=/dev/null count=1 {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:16:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "dd if=/dev/sdc of=/dev/null count=1" returned: 0 in 0.019s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:16:00 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c68ec1b-b643-420b-8c27-d699c26c8d3e]: (4, ('', '1+0 records in\n1+0 records out\n512 bytes copied, 0.0023454 s, 218 kB/s\n')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:16:00 user cinder-volume[73403]: DEBUG cinder.image.image_utils [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] 230ce209-30a2-4453-b537-b06c1463ee3a was raw, no need to convert to raw {{(pid=73403) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1004}} Apr 14 03:16:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1001 /dev/sdc {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:16:00 user sudo[95419]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1001 /dev/sdc Apr 14 03:16:00 user sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 03:16:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] get volume v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:16:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_56bf979e-e582-4b65-a641-e67f199f7b62@v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443566', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113579', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13111990297540597475', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '647dc3842ea31140', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265018368', 'san:volume_id': '647dc3842ea31140653008049f93b97c6a7f26fd', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85354', 'name': 'v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] delete snapshot v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 of volume s_56bf979e-e582-4b65-a641-e67f199f7b62 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:16:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_56bf979e-e582-4b65-a641-e67f199f7b62/snapshots/v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_56bf979e-e582-4b65-a641-e67f199f7b62/snapshots/v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:00 user sudo[95419]: pam_unix(sudo:session): session closed for user root Apr 14 03:16:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1001 /dev/sdc" returned: 0 in 0.763s {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:16:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-80f70d52-e94a-4139-a502-c86db45dbb4c req-d79dd469-d286-420c-82ba-dda05b3c69bc tempest-SnapshotDataIntegrityTests-450991924 None] terminate connection for d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:16:01 user cinder-volume[73403]: INFO cinder.volume.manager [req-80f70d52-e94a-4139-a502-c86db45dbb4c req-d79dd469-d286-420c-82ba-dda05b3c69bc tempest-SnapshotDataIntegrityTests-450991924 None] Terminate volume connection completed successfully. Apr 14 03:16:01 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-80f70d52-e94a-4139-a502-c86db45dbb4c req-d79dd469-d286-420c-82ba-dda05b3c69bc tempest-SnapshotDataIntegrityTests-450991924 None] Deleting attachment f43baa05-9a69-4e42-9354-87cf3649e8f6. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:16:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-80f70d52-e94a-4139-a502-c86db45dbb4c req-d79dd469-d286-420c-82ba-dda05b3c69bc tempest-SnapshotDataIntegrityTests-450991924 None] remove_export for volume: d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:16:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-80f70d52-e94a-4139-a502-c86db45dbb4c req-d79dd469-d286-420c-82ba-dda05b3c69bc tempest-SnapshotDataIntegrityTests-450991924 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:16:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-80f70d52-e94a-4139-a502-c86db45dbb4c req-d79dd469-d286-420c-82ba-dda05b3c69bc tempest-SnapshotDataIntegrityTests-450991924 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1380512440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e,launched_at=2023-04-14T03:15:32Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0096d0892acf4d5f8a0fa290a18b451a',provider_auth='CHAP QsIZOXnq 42OF6rVHTysz8B',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:31Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:16:00Z,use_quota=True,user_id='ba8614e27c65428d92e4bf01969976e7',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:16:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-80f70d52-e94a-4139-a502-c86db45dbb4c req-d79dd469-d286-420c-82ba-dda05b3c69bc tempest-SnapshotDataIntegrityTests-450991924 None] detach volume v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e from target iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:16:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80f70d52-e94a-4139-a502-c86db45dbb4c req-d79dd469-d286-420c-82ba-dda05b3c69bc tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/luns/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80f70d52-e94a-4139-a502-c86db45dbb4c req-d79dd469-d286-420c-82ba-dda05b3c69bc tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/luns/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80f70d52-e94a-4139-a502-c86db45dbb4c req-d79dd469-d286-420c-82ba-dda05b3c69bc tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/luns/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-80f70d52-e94a-4139-a502-c86db45dbb4c req-d79dd469-d286-420c-82ba-dda05b3c69bc tempest-SnapshotDataIntegrityTests-450991924 None] delete target: iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:16:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-80f70d52-e94a-4139-a502-c86db45dbb4c req-d79dd469-d286-420c-82ba-dda05b3c69bc tempest-SnapshotDataIntegrityTests-450991924 None] delete target iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:16:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80f70d52-e94a-4139-a502-c86db45dbb4c req-d79dd469-d286-420c-82ba-dda05b3c69bc tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80f70d52-e94a-4139-a502-c86db45dbb4c req-d79dd469-d286-420c-82ba-dda05b3c69bc tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80f70d52-e94a-4139-a502-c86db45dbb4c req-d79dd469-d286-420c-82ba-dda05b3c69bc tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-80f70d52-e94a-4139-a502-c86db45dbb4c req-d79dd469-d286-420c-82ba-dda05b3c69bc tempest-SnapshotDataIntegrityTests-450991924 None] target iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:16:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_56bf979e-e582-4b65-a641-e67f199f7b62/snapshots/v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] snapshot v_1c8ba7e9-8821-4d4f-8565-a9c1e0f8e668 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:16:01 user cinder-volume[73403]: DEBUG cinder.quota [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Created reservations ['317d7a52-bda8-4d77-8e14-c77b3e870ae5'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:16:01 user cinder-volume[73403]: WARNING cinder.quota [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1356235295 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1356235295, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:16:01 user cinder-volume[73403]: WARNING cinder.quota [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1356235295 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1356235295, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:16:01 user cinder-volume[73403]: DEBUG cinder.quota [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Created reservations ['825076f6-1a08-4f22-882d-a8e62ca0ba6d', '2d8a8625-1194-46f4-857f-57ebd1f6ea09', '1c08c081-e6cf-411d-b741-6fd8409ff5c7', '6d854085-d671-4df0-b73b-d4a7ceaa851d'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:16:02 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=65,cinder:UPDATE=31,cinder:INSERT=4 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:16:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:16:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'available': '114265067520', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:16:02 user cinder-volume[73403]: DEBUG cinder.manager [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:16:02 user cinder-volume[73403]: INFO cinder.volume.manager [None req-85804d2a-0fad-453d-a297-4946c6153ef4 tempest-GroupSnapshotsTest-1003911629 None] Delete group completed successfully. Apr 14 03:16:02 user cinder-volume[73403]: INFO cinder.volume.manager [None req-2d6e0ccb-9193-471c-8cd1-51f09d67a996 tempest-GroupSnapshotsTest-1003911629 None] group_snapshot 4a48943b-4198-4a77-ab19-a2a0712c0dfe: deleting Apr 14 03:16:02 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-2d6e0ccb-9193-471c-8cd1-51f09d67a996 tempest-GroupSnapshotsTest-1003911629 None] group_snapshot 4a48943b-4198-4a77-ab19-a2a0712c0dfe: deleting {{(pid=73403) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4304}} Apr 14 03:16:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2d6e0ccb-9193-471c-8cd1-51f09d67a996 tempest-GroupSnapshotsTest-1003911629 None] deleating snapshot s_56bf979e-e582-4b65-a641-e67f199f7b62. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:16:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2d6e0ccb-9193-471c-8cd1-51f09d67a996 tempest-GroupSnapshotsTest-1003911629 None] get snapshots for volume s_56bf979e-e582-4b65-a641-e67f199f7b62 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:16:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d6e0ccb-9193-471c-8cd1-51f09d67a996 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_56bf979e-e582-4b65-a641-e67f199f7b62/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d6e0ccb-9193-471c-8cd1-51f09d67a996 tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_56bf979e-e582-4b65-a641-e67f199f7b62/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:16:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:16:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:16:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d6e0ccb-9193-471c-8cd1-51f09d67a996 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_56bf979e-e582-4b65-a641-e67f199f7b62/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2d6e0ccb-9193-471c-8cd1-51f09d67a996 tempest-GroupSnapshotsTest-1003911629 None] get volume s_56bf979e-e582-4b65-a641-e67f199f7b62 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:16:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d6e0ccb-9193-471c-8cd1-51f09d67a996 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_56bf979e-e582-4b65-a641-e67f199f7b62 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d6e0ccb-9193-471c-8cd1-51f09d67a996 tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_56bf979e-e582-4b65-a641-e67f199f7b62 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d6e0ccb-9193-471c-8cd1-51f09d67a996 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_07b62be3-201e-48e1-b5bd-8bb3395469e9@s_56bf979e-e582-4b65-a641-e67f199f7b62', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_56bf979e-e582-4b65-a641-e67f199f7b62', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443563', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113563', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13690752006904976820', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9646e1b3a5e6cb1b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265067520', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '85332', 'name': 's_56bf979e-e582-4b65-a641-e67f199f7b62', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_56bf979e-e582-4b65-a641-e67f199f7b62 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2d6e0ccb-9193-471c-8cd1-51f09d67a996 tempest-GroupSnapshotsTest-1003911629 None] delete snapshot s_56bf979e-e582-4b65-a641-e67f199f7b62 of volume v_07b62be3-201e-48e1-b5bd-8bb3395469e9 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:16:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d6e0ccb-9193-471c-8cd1-51f09d67a996 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07b62be3-201e-48e1-b5bd-8bb3395469e9/snapshots/s_56bf979e-e582-4b65-a641-e67f199f7b62 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d6e0ccb-9193-471c-8cd1-51f09d67a996 tempest-GroupSnapshotsTest-1003911629 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07b62be3-201e-48e1-b5bd-8bb3395469e9/snapshots/s_56bf979e-e582-4b65-a641-e67f199f7b62 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114265067520', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:16:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:16:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d6e0ccb-9193-471c-8cd1-51f09d67a996 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07b62be3-201e-48e1-b5bd-8bb3395469e9/snapshots/s_56bf979e-e582-4b65-a641-e67f199f7b62 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2d6e0ccb-9193-471c-8cd1-51f09d67a996 tempest-GroupSnapshotsTest-1003911629 None] snapshot s_56bf979e-e582-4b65-a641-e67f199f7b62 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:16:05 user cinder-volume[73403]: WARNING cinder.quota [None req-2d6e0ccb-9193-471c-8cd1-51f09d67a996 tempest-GroupSnapshotsTest-1003911629 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1356235295 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1356235295, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:16:05 user cinder-volume[73403]: DEBUG cinder.quota [None req-2d6e0ccb-9193-471c-8cd1-51f09d67a996 tempest-GroupSnapshotsTest-1003911629 None] Created reservations ['0fbcaf3b-7453-43cf-b9f5-3500ac22cef5', '45894323-ce33-4679-8c38-83983f4ddd46', 'ecfca39e-0e64-4134-a57b-c3f3ddcb12a9', '96250c05-578a-42e8-9dd7-3eca28d23f3a'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:16:05 user cinder-volume[73403]: INFO cinder.volume.manager [None req-2d6e0ccb-9193-471c-8cd1-51f09d67a996 tempest-GroupSnapshotsTest-1003911629 None] group_snapshot 4a48943b-4198-4a77-ab19-a2a0712c0dfe: deleted successfully Apr 14 03:16:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] remove_export for volume: 07b62be3-201e-48e1-b5bd-8bb3395469e9. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:16:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:16:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1914582324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ad8c1321-4787-4ad0-8d16-a5526f485816,host='user@joviandss-2#joviandss-2',id=07b62be3-201e-48e1-b5bd-8bb3395469e9,launched_at=2023-04-14T03:15:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0d5639765ed45e9b679f038a2775982',provider_auth='CHAP AHzpgxyi tgDxKiHOzeVBQh',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b62be3-201e-48e1-b5bd-8bb3395469e9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:52Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T03:16:06Z,use_quota=True,user_id='177ee2ef30a24897a01a934cd31c755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10fe10fc-1669-4bbb-8bd2-b2ff0b881ebe),volume_type_id=10fe10fc-1669-4bbb-8bd2-b2ff0b881ebe) from target:iqn.2010-10.org.openstack:07b62be3-201e-48e1-b5bd-8bb3395469e9. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:16:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] detach volume v_07b62be3-201e-48e1-b5bd-8bb3395469e9 from target iqn.2010-10.org.openstack:07b62be3-201e-48e1-b5bd-8bb3395469e9 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:16:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07b62be3-201e-48e1-b5bd-8bb3395469e9/luns/v_07b62be3-201e-48e1-b5bd-8bb3395469e9 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07b62be3-201e-48e1-b5bd-8bb3395469e9/luns/v_07b62be3-201e-48e1-b5bd-8bb3395469e9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:07b62be3-201e-48e1-b5bd-8bb3395469e9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07b62be3-201e-48e1-b5bd-8bb3395469e9/luns/v_07b62be3-201e-48e1-b5bd-8bb3395469e9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07b62be3-201e-48e1-b5bd-8bb3395469e9/luns/v_07b62be3-201e-48e1-b5bd-8bb3395469e9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] failed to remove resource iqn.2010-10.org.openstack:07b62be3-201e-48e1-b5bd-8bb3395469e9 because of JDSS resource v_07b62be3-201e-48e1-b5bd-8bb3395469e9 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:16:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] delete target: iqn.2010-10.org.openstack:07b62be3-201e-48e1-b5bd-8bb3395469e9 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:16:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] delete target iqn.2010-10.org.openstack:07b62be3-201e-48e1-b5bd-8bb3395469e9 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:16:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07b62be3-201e-48e1-b5bd-8bb3395469e9 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07b62be3-201e-48e1-b5bd-8bb3395469e9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:07b62be3-201e-48e1-b5bd-8bb3395469e9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07b62be3-201e-48e1-b5bd-8bb3395469e9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07b62be3-201e-48e1-b5bd-8bb3395469e9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] failed to remove resource iqn.2010-10.org.openstack:07b62be3-201e-48e1-b5bd-8bb3395469e9 because of JDSS resource iqn.2010-10.org.openstack:07b62be3-201e-48e1-b5bd-8bb3395469e9 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:16:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] deleating volume v_07b62be3-201e-48e1-b5bd-8bb3395469e9 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:16:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] get snapshots for volume v_07b62be3-201e-48e1-b5bd-8bb3395469e9 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:16:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07b62be3-201e-48e1-b5bd-8bb3395469e9/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07b62be3-201e-48e1-b5bd-8bb3395469e9/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07b62be3-201e-48e1-b5bd-8bb3395469e9/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] get volume v_07b62be3-201e-48e1-b5bd-8bb3395469e9 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:16:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07b62be3-201e-48e1-b5bd-8bb3395469e9 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07b62be3-201e-48e1-b5bd-8bb3395469e9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_07b62be3-201e-48e1-b5bd-8bb3395469e9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443561', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113556', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12350352111200590736', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4b7f9a86856b9df9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265092096', 'san:volume_id': '4b7f9a86856b9df92b58640b66377b8c8c3157e7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85317', 'name': 'v_07b62be3-201e-48e1-b5bd-8bb3395469e9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07b62be3-201e-48e1-b5bd-8bb3395469e9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] delete volume:v_07b62be3-201e-48e1-b5bd-8bb3395469e9 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:16:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07b62be3-201e-48e1-b5bd-8bb3395469e9 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07b62be3-201e-48e1-b5bd-8bb3395469e9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07b62be3-201e-48e1-b5bd-8bb3395469e9 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] volume v_07b62be3-201e-48e1-b5bd-8bb3395469e9 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:16:09 user cinder-volume[73403]: DEBUG cinder.quota [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Created reservations ['7b9646b5-be0c-4240-841a-d81ab246dbc5'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:16:09 user cinder-volume[73403]: WARNING cinder.db.sqlalchemy.api [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1356235295'] Apr 14 03:16:09 user cinder-volume[73403]: DEBUG cinder.quota [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Created reservations ['40294f7a-3b50-4b05-ab2d-8bf11c3e6eb7', '3b690801-9223-4663-8d7a-c0ad240ac4b2', '71474eb5-8d75-4097-b1ab-feae37837652', '3d25885f-73f1-41d1-96ad-20b70e05a75b'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:16:09 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=61,cinder:UPDATE=32,cinder:DELETE=2,cinder:INSERT=5 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:16:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:16:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'available': '114265161728', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:16:10 user cinder-volume[73403]: DEBUG cinder.manager [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:16:10 user cinder-volume[73403]: INFO cinder.volume.manager [None req-cc26e933-5a45-46ad-a66a-a11566afa788 tempest-GroupSnapshotsTest-1003911629 None] Delete group completed successfully. Apr 14 03:16:10 user cinder-volume[73403]: INFO cinder.volume.manager [None req-d78c8cd4-2985-48a1-a4a3-58d2b8452a2f tempest-GroupSnapshotsTest-1003911629 None] Group tempest-GroupSnapshotsTest-Group-1464191118: creating Apr 14 03:16:10 user cinder-volume[73403]: INFO cinder.volume.manager [None req-d78c8cd4-2985-48a1-a4a3-58d2b8452a2f tempest-GroupSnapshotsTest-1003911629 None] Group tempest-GroupSnapshotsTest-Group-1464191118: created successfully Apr 14 03:16:10 user cinder-volume[73403]: INFO cinder.volume.manager [None req-d78c8cd4-2985-48a1-a4a3-58d2b8452a2f tempest-GroupSnapshotsTest-1003911629 None] Create group completed successfully. Apr 14 03:16:11 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:16:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Flow 'volume_create_manager' (12535bba-0b2e-4ee3-985a-071206cda46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:16:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbba756d-40cb-44d6-bde8-3d8cac907393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbba756d-40cb-44d6-bde8-3d8cac907393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-523090251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e3e6fd2a-575b-4505-aada-5c9afba0d6c4,host='user@joviandss-2#joviandss-2',id=b19d5a1c-cf0f-4da6-96f7-918897c16c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0d5639765ed45e9b679f038a2775982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:16:12Z,use_quota=True,user_id='177ee2ef30a24897a01a934cd31c755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12d23ce1-e801-4540-9c6f-67fddfbbccd6),volume_type_id=12d23ce1-e801-4540-9c6f-67fddfbbccd6)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ed44f5-39d7-42d0-88f0-2a2ab6a0d4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ed44f5-39d7-42d0-88f0-2a2ab6a0d4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1575a2e0-1825-41d9-a007-7a4617fec79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1575a2e0-1825-41d9-a007-7a4617fec79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b19d5a1c-cf0f-4da6-96f7-918897c16c6c', 'volume_name': 'volume-b19d5a1c-cf0f-4da6-96f7-918897c16c6c', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51de736-43be-44a7-b4f5-26f1c771db50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51de736-43be-44a7-b4f5-26f1c771db50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c7ea40-1105-4580-ab5c-71a0f44d6190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:11 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Volume b19d5a1c-cf0f-4da6-96f7-918897c16c6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b19d5a1c-cf0f-4da6-96f7-918897c16c6c', 'volume_size': 1} Apr 14 03:16:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] creating volume v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:16:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] create volume {'name': 'v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:16:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c', 'is_clone': False, 'name': 'v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c7ea40-1105-4580-ab5c-71a0f44d6190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b19d5a1c-cf0f-4da6-96f7-918897c16c6c', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7615db0-94de-4e95-83a9-e8879ca98fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:13 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Volume volume-b19d5a1c-cf0f-4da6-96f7-918897c16c6c (b19d5a1c-cf0f-4da6-96f7-918897c16c6c): created successfully Apr 14 03:16:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7615db0-94de-4e95-83a9-e8879ca98fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Flow 'volume_create_manager' (12535bba-0b2e-4ee3-985a-071206cda46c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:16:13 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a64abcc1-d7d9-487c-bfba-d29b46193111 tempest-GroupSnapshotsTest-1003911629 None] Created volume successfully. Apr 14 03:16:15 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:16:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Flow 'volume_create_manager' (a9000457-eb8b-428f-8de3-b5b2d03a7166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:16:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483c99ca-c5d2-4b86-b8c4-955be5ea5fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483c99ca-c5d2-4b86-b8c4-955be5ea5fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-884205491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e3e6fd2a-575b-4505-aada-5c9afba0d6c4,host='user@joviandss-2#joviandss-2',id=bca075b3-5d38-4359-b822-e71a1e9a122b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0d5639765ed45e9b679f038a2775982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:16:15Z,use_quota=True,user_id='177ee2ef30a24897a01a934cd31c755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12d23ce1-e801-4540-9c6f-67fddfbbccd6),volume_type_id=12d23ce1-e801-4540-9c6f-67fddfbbccd6)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f990a6-e4d3-4853-856f-426f9675fa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f990a6-e4d3-4853-856f-426f9675fa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33f2b39-3076-4c13-9a76-8f31d9c0af78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33f2b39-3076-4c13-9a76-8f31d9c0af78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bca075b3-5d38-4359-b822-e71a1e9a122b', 'volume_name': 'volume-bca075b3-5d38-4359-b822-e71a1e9a122b', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eed22aa-7a59-439c-b30e-d8d44cf519ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eed22aa-7a59-439c-b30e-d8d44cf519ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376f6b20-3f32-4a83-9b63-b20acb2b85db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:15 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Volume bca075b3-5d38-4359-b822-e71a1e9a122b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bca075b3-5d38-4359-b822-e71a1e9a122b', 'volume_size': 1} Apr 14 03:16:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] creating volume v_bca075b3-5d38-4359-b822-e71a1e9a122b. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:16:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] create volume {'name': 'v_bca075b3-5d38-4359-b822-e71a1e9a122b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:16:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_bca075b3-5d38-4359-b822-e71a1e9a122b', 'is_clone': False, 'name': 'v_bca075b3-5d38-4359-b822-e71a1e9a122b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:16 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376f6b20-3f32-4a83-9b63-b20acb2b85db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca075b3-5d38-4359-b822-e71a1e9a122b', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:16 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5bebe2-36fe-43c6-a163-e7141834ebc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:16 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Volume volume-bca075b3-5d38-4359-b822-e71a1e9a122b (bca075b3-5d38-4359-b822-e71a1e9a122b): created successfully Apr 14 03:16:16 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5bebe2-36fe-43c6-a163-e7141834ebc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:16 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Flow 'volume_create_manager' (a9000457-eb8b-428f-8de3-b5b2d03a7166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:16:16 user cinder-volume[73403]: INFO cinder.volume.manager [None req-c2d2f945-9b8f-4bba-b78e-7c8f752492aa tempest-GroupSnapshotsTest-1003911629 None] Created volume successfully. Apr 14 03:16:17 user cinder-volume[73403]: INFO cinder.volume.manager [None req-83866c6f-4214-492f-81bc-8546819ee7fe tempest-GroupSnapshotsTest-1003911629 None] Update group completed successfully. Apr 14 03:16:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-31966cfb-f5e0-434f-8ff6-81da1efe4bca tempest-ServerActionsTestJSON-1848627478 None] terminate connection for 7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:16:17 user cinder-volume[73403]: INFO cinder.volume.manager [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-31966cfb-f5e0-434f-8ff6-81da1efe4bca tempest-ServerActionsTestJSON-1848627478 None] Terminate volume connection completed successfully. Apr 14 03:16:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-31966cfb-f5e0-434f-8ff6-81da1efe4bca tempest-ServerActionsTestJSON-1848627478 None] Deleting attachment 237abed3-9ad3-4617-8ee3-b0428e0a2a34. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:16:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-31966cfb-f5e0-434f-8ff6-81da1efe4bca tempest-ServerActionsTestJSON-1848627478 None] remove_export for volume: 7378e388-0e78-4212-b0ce-a1e082ba31ab. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:16:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-31966cfb-f5e0-434f-8ff6-81da1efe4bca tempest-ServerActionsTestJSON-1848627478 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:16:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-31966cfb-f5e0-434f-8ff6-81da1efe4bca tempest-ServerActionsTestJSON-1848627478 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1077479502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7378e388-0e78-4212-b0ce-a1e082ba31ab,launched_at=2023-04-14T03:14:17Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='4075885e26cb4adaad24d3ae6217fe35',provider_auth='CHAP tUxPOhHN Gu7Z2kmnVyRwaX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:14:15Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:14:24Z,use_quota=True,user_id='7dea23743ba945c4a9d539b8e277c653',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:16:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-31966cfb-f5e0-434f-8ff6-81da1efe4bca tempest-ServerActionsTestJSON-1848627478 None] detach volume v_7378e388-0e78-4212-b0ce-a1e082ba31ab from target iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:16:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-31966cfb-f5e0-434f-8ff6-81da1efe4bca tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/luns/v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-31966cfb-f5e0-434f-8ff6-81da1efe4bca tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/luns/v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-31966cfb-f5e0-434f-8ff6-81da1efe4bca tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/luns/v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-31966cfb-f5e0-434f-8ff6-81da1efe4bca tempest-ServerActionsTestJSON-1848627478 None] delete target: iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:16:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-31966cfb-f5e0-434f-8ff6-81da1efe4bca tempest-ServerActionsTestJSON-1848627478 None] delete target iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:16:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-31966cfb-f5e0-434f-8ff6-81da1efe4bca tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-31966cfb-f5e0-434f-8ff6-81da1efe4bca tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-31966cfb-f5e0-434f-8ff6-81da1efe4bca tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-31966cfb-f5e0-434f-8ff6-81da1efe4bca tempest-ServerActionsTestJSON-1848627478 None] target iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:16:18 user cinder-volume[73403]: INFO cinder.volume.manager [None req-d660b9d4-2967-43e5-909b-cb5fa9b565b9 tempest-GroupSnapshotsTest-1003911629 None] Update group completed successfully. Apr 14 03:16:19 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:16:19 user sudo[95580]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc Apr 14 03:16:19 user sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 03:16:20 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=27,cinder:SELECT=64,cinder:INSERT=8,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:20 user cinder-volume[73403]: INFO cinder.volume.manager [None req-0f56e5ab-273f-4847-935e-ebc48309e859 tempest-GroupSnapshotsTest-1003911629 None] Update group completed successfully. Apr 14 03:16:20 user sudo[95580]: pam_unix(sudo:session): session closed for user root Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc" returned: 0 in 0.805s {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jOXbqBQa', 'auth_password': '***', 'target_lun': 0, 'encrypted': False}, {'type': 'block', 'scsi_wwn': '26263393562393561', 'path': '/dev/sdc'}), 'kwargs': {'force': True}}" {{(pid=73403) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdec5fc-4cd2-443b-88f5-0d2e0ab1ebb8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Apr 14 03:16:20 user cinder-volume[73403]: No targets found. Apr 14 03:16:20 user cinder-volume[73403]: iSNS: Apr 14 03:16:20 user cinder-volume[73403]: No targets found. Apr 14 03:16:20 user cinder-volume[73403]: STATIC: Apr 14 03:16:20 user cinder-volume[73403]: Target: iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff Apr 14 03:16:20 user cinder-volume[73403]: Portal: 172.16.0.220:3260,-1 Apr 14 03:16:20 user cinder-volume[73403]: Iface Name: default Apr 14 03:16:20 user cinder-volume[73403]: Target: iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 Apr 14 03:16:20 user cinder-volume[73403]: Portal: 172.16.0.220:3260,-1 Apr 14 03:16:20 user cinder-volume[73403]: Iface Name: default Apr 14 03:16:20 user cinder-volume[73403]: Target: iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c Apr 14 03:16:20 user cinder-volume[73403]: Portal: 172.16.0.220:3260,-1 Apr 14 03:16:20 user cinder-volume[73403]: Iface Name: default Apr 14 03:16:20 user cinder-volume[73403]: FIRMWARE: Apr 14 03:16:20 user cinder-volume[73403]: No targets found. Apr 14 03:16:20 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Regex to get portals from discoverydb: ^SENDTARGETS: Apr 14 03:16:20 user cinder-volume[73403]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Apr 14 03:16:20 user cinder-volume[73403]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=73403) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169', 0)] {{(pid=73403) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e845feb-94a4-4354-b041-825b4da817f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fae7ea7-cbe7-4f22-9da6-f7a247b292a0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 (non-flash)\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c (non-flash) Apr 14 03:16:20 user cinder-volume[73403]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff (non-flash) Apr 14 03:16:20 user cinder-volume[73403]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 (non-flash) Apr 14 03:16:20 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c (non-flash) Apr 14 03:16:20 user cinder-volume[73403]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff (non-flash) Apr 14 03:16:20 user cinder-volume[73403]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 (non-flash) Apr 14 03:16:20 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Resulting device map defaultdict(. at 0x7f81eedc72e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169'): ({'sdc'}, set())}) {{(pid=73403) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Removing single pathed devices sdc {{(pid=73403) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] create export for volume: 7378e388-0e78-4212-b0ce-a1e082ba31ab. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] ensure volume 7378e388-0e78-4212-b0ce-a1e082ba31ab assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] check if targe iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[722d3a9a-9bf7-4f9a-86c8-350042853bc4]: (4, ('path checker states:\nup 3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] create target and attach volume 7378e388-0e78-4212-b0ce-a1e082ba31ab to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] create target iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7220f3-59bb-4bc0-88f1-7c66b73a6a92]: (4, ('ok\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Flushing IO for device /dev/sdc {{(pid=73403) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b6e619-b63f-4c19-9b5a-af2d58509880]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73403) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef81b29-346c-4afa-8975-898719977416]: (4, ('1', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=73403) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] SCSI volumes sdc have been removed. {{(pid=73403) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169')] {{(pid=73403) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af47155-d211-4f11-9917-39fb68f890cb]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 --logout {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fc5f1b-5ed6-49a6-9eb0-4760999a2810]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169, portal: 172.16.0.220,3260] Apr 14 03:16:20 user cinder-volume[73403]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169, portal: 172.16.0.220,3260] successful. Apr 14 03:16:20 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 --op delete {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad95d36-98d6-4ed2-93dd-54941c2a6623]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] <== disconnect_volume: return (293ms) None {{(pid=73403) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] terminate connection for 117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG cinder.volume.driver [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] volume 117adce3-717a-4664-8cfa-be7d1f5d0169: removing export {{(pid=73403) _detach_volume /opt/stack/cinder/cinder/volume/driver.py:560}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] remove_export for volume: 117adce3-717a-4664-8cfa-be7d1f5d0169. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-569973521',ec2_id=None,encryption_key_id=None,glance_metadata={},group=,group_id=None,host='user@joviandss-2#joviandss-2',id=117adce3-717a-4664-8cfa-be7d1f5d0169,launched_at=2023-04-14T03:10:24Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='1318728a20064d49b9c1b2f89175a364',provider_auth='CHAP jOXbqBQa yUTrKfO7vhBHQz',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:10:23Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='uploading',terminated_at=None,updated_at=2023-04-14T03:15:51Z,use_quota=True,user_id='b2facbf385e8402c86706cc28d4707af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] detach volume v_117adce3-717a-4664-8cfa-be7d1f5d0169 from target iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/luns/v_117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/luns/v_117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/luns/v_117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] delete target: iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:16:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] delete target iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:16:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:21 user cinder-volume[73403]: INFO cinder.volume.manager [None req-e7d1b448-330e-4283-860f-e565acce098b tempest-GroupSnapshotsTest-1003911629 None] Update group completed successfully. Apr 14 03:16:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] target iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:16:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Uploaded volume to glance image-id: 230ce209-30a2-4453-b537-b06c1463ee3a. {{(pid=73403) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1793}} Apr 14 03:16:21 user cinder-volume[73403]: INFO cinder.volume.manager [None req-285db8de-40c1-44f2-8b71-b10f512a21a5 tempest-VolumesActionsTest-121883605 None] Copy volume to image completed successfully. Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Acquiring lock "cinder-117adce3-717a-4664-8cfa-be7d1f5d0169-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Lock "cinder-117adce3-717a-4664-8cfa-be7d1f5d0169-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] remove_export for volume: 117adce3-717a-4664-8cfa-be7d1f5d0169. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] detach volume:Volume(_name_id=None,admin_metadata={readonly='False'},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-569973521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=117adce3-717a-4664-8cfa-be7d1f5d0169,launched_at=2023-04-14T03:10:24Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='1318728a20064d49b9c1b2f89175a364',provider_auth='CHAP jOXbqBQa yUTrKfO7vhBHQz',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:10:23Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:16:23Z,updated_at=2023-04-14T03:16:23Z,use_quota=True,user_id='b2facbf385e8402c86706cc28d4707af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] detach volume v_117adce3-717a-4664-8cfa-be7d1f5d0169 from target iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/luns/v_117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/luns/v_117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/luns/v_117adce3-717a-4664-8cfa-be7d1f5d0169'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169/luns/v_117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] failed to remove resource iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 because of JDSS resource v_117adce3-717a-4664-8cfa-be7d1f5d0169 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] delete target: iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] delete target iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:22 user cinder-volume[73403]: INFO cinder.volume.manager [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] GroupSnapshot 8015cc2d-675f-4467-8fe1-952732469a5a: creating. Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] failed to remove resource iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 because of JDSS resource iqn.2010-10.org.openstack:117adce3-717a-4664-8cfa-be7d1f5d0169 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] deleating volume v_117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] get snapshots for volume v_117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_117adce3-717a-4664-8cfa-be7d1f5d0169/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_117adce3-717a-4664-8cfa-be7d1f5d0169/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] Group snapshot 8015cc2d-675f-4467-8fe1-952732469a5a: creating. {{(pid=73403) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4129}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] create snapshot 2270c3dd-8d4a-4057-b07d-080cee2829cb for volume bca075b3-5d38-4359-b822-e71a1e9a122b {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] cloning v_bca075b3-5d38-4359-b822-e71a1e9a122b to s_2270c3dd-8d4a-4057-b07d-080cee2829cb {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] create snapshot s_2270c3dd-8d4a-4057-b07d-080cee2829cb {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca075b3-5d38-4359-b822-e71a1e9a122b/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca075b3-5d38-4359-b822-e71a1e9a122b/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] atach volume v_7378e388-0e78-4212-b0ce-a1e082ba31ab to target iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:16:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_117adce3-717a-4664-8cfa-be7d1f5d0169/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] get volume v_117adce3-717a-4664-8cfa-be7d1f5d0169 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:16:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_117adce3-717a-4664-8cfa-be7d1f5d0169', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443233', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113216', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18173337200926150597', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bc95b95a35dca7fa', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265022464', 'san:volume_id': 'bc95b95a35dca7fac633fef34c5443c821e2de84', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '84057', 'name': 'v_117adce3-717a-4664-8cfa-be7d1f5d0169', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] delete volume:v_117adce3-717a-4664-8cfa-be7d1f5d0169 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:16:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_2270c3dd-8d4a-4057-b07d-080cee2829cb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca075b3-5d38-4359-b822-e71a1e9a122b/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] create volume s_2270c3dd-8d4a-4057-b07d-080cee2829cb from snapshot s_2270c3dd-8d4a-4057-b07d-080cee2829cb {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:16:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca075b3-5d38-4359-b822-e71a1e9a122b/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca075b3-5d38-4359-b822-e71a1e9a122b/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3031383739646233', 'lun': 0, 'mode': 'wt', 'name': 'v_7378e388-0e78-4212-b0ce-a1e082ba31ab', 'prod_id': 'Storage', 'scsi_id': '01879db36f93b921'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] add credentails to target iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 201, 'error': None, 'data': {'name': 'tUxPOhHN'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] initialize_connection for 7378e388-0e78-4212-b0ce-a1e082ba31ab 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUxPOhHN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '43ac2eb3-9113-4367-a91a-8cd526f86d35'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:16:24 user cinder-volume[73403]: INFO cinder.volume.manager [req-776ea954-fcb1-4fd4-a43f-418774ad4286 req-1680e884-7f01-4e53-9083-f707bda31135 tempest-ServerActionsTestJSON-1848627478 None] attachment_update completed successfully. Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_bca075b3-5d38-4359-b822-e71a1e9a122b@s_2270c3dd-8d4a-4057-b07d-080cee2829cb', 'is_clone': True, 'full_name': 'Pool-0/s_2270c3dd-8d4a-4057-b07d-080cee2829cb', 'name': 's_2270c3dd-8d4a-4057-b07d-080cee2829cb'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca075b3-5d38-4359-b822-e71a1e9a122b/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2270c3dd-8d4a-4057-b07d-080cee2829cb/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2270c3dd-8d4a-4057-b07d-080cee2829cb/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2270c3dd-8d4a-4057-b07d-080cee2829cb/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] volume s_2270c3dd-8d4a-4057-b07d-080cee2829cb properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] create snapshot 9e96a941-8899-4405-9d75-c6f3309e6967 for volume b19d5a1c-cf0f-4da6-96f7-918897c16c6c {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] cloning v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c to s_9e96a941-8899-4405-9d75-c6f3309e6967 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] create snapshot s_9e96a941-8899-4405-9d75-c6f3309e6967 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_117adce3-717a-4664-8cfa-be7d1f5d0169 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] volume v_117adce3-717a-4664-8cfa-be7d1f5d0169 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.quota [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Created reservations ['8f54e7fd-a803-404c-9af9-cb8e094ebafd', '59047193-c19c-4e3e-9739-525fe952d9d3', 'be7c179f-88f4-455f-a779-4e769969350e', '545583c1-ce40-4222-9151-f3595c29ca9e'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Geting {'code': 200, 'error': None, 'data': {'available': '114265092096', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:16:25 user cinder-volume[73403]: DEBUG cinder.manager [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:16:25 user cinder-volume[73403]: INFO cinder.volume.manager [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Deleted volume successfully. Apr 14 03:16:25 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5c7d834e-3a2c-41d8-b474-bdc2f75c078c tempest-VolumesActionsTest-121883605 None] Lock "cinder-117adce3-717a-4664-8cfa-be7d1f5d0169-delete_volume" released by "delete_volume" :: held 3.131s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:16:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_9e96a941-8899-4405-9d75-c6f3309e6967'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] create volume s_9e96a941-8899-4405-9d75-c6f3309e6967 from snapshot s_9e96a941-8899-4405-9d75-c6f3309e6967 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:16:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c@s_9e96a941-8899-4405-9d75-c6f3309e6967', 'is_clone': True, 'full_name': 'Pool-0/s_9e96a941-8899-4405-9d75-c6f3309e6967', 'name': 's_9e96a941-8899-4405-9d75-c6f3309e6967'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9e96a941-8899-4405-9d75-c6f3309e6967/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9e96a941-8899-4405-9d75-c6f3309e6967/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9e96a941-8899-4405-9d75-c6f3309e6967/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] volume s_9e96a941-8899-4405-9d75-c6f3309e6967 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:16:26 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=68,cinder:UPDATE=29,cinder:DELETE=2,cinder:INSERT=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-53e2dc12-049d-4b69-9624-055d130919eb req-14fe8eb7-9638-42c7-acda-e3323a3aa3e5 tempest-ServerStableDeviceRescueTest-1642713032 None] terminate connection for 7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:16:26 user cinder-volume[73403]: INFO cinder.volume.manager [req-53e2dc12-049d-4b69-9624-055d130919eb req-14fe8eb7-9638-42c7-acda-e3323a3aa3e5 tempest-ServerStableDeviceRescueTest-1642713032 None] Terminate volume connection completed successfully. Apr 14 03:16:26 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-53e2dc12-049d-4b69-9624-055d130919eb req-14fe8eb7-9638-42c7-acda-e3323a3aa3e5 tempest-ServerStableDeviceRescueTest-1642713032 None] Deleting attachment 6bc4d910-81cd-4cad-b971-4d1cd3ba9cf2. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:16:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-53e2dc12-049d-4b69-9624-055d130919eb req-14fe8eb7-9638-42c7-acda-e3323a3aa3e5 tempest-ServerStableDeviceRescueTest-1642713032 None] remove_export for volume: 7fff5d89-4516-4be1-9698-f088498889ff. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:16:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-53e2dc12-049d-4b69-9624-055d130919eb req-14fe8eb7-9638-42c7-acda-e3323a3aa3e5 tempest-ServerStableDeviceRescueTest-1642713032 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:16:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-53e2dc12-049d-4b69-9624-055d130919eb req-14fe8eb7-9638-42c7-acda-e3323a3aa3e5 tempest-ServerStableDeviceRescueTest-1642713032 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1347917722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7fff5d89-4516-4be1-9698-f088498889ff,launched_at=2023-04-14T03:13:53Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='82eb4fbf55f04294a3d97800142bdca9',provider_auth='CHAP weNMmovz NGKx8bUglf504k',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:13:51Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:16:26Z,use_quota=True,user_id='3c683fe5636b49858857033797ff8e68',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:16:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-53e2dc12-049d-4b69-9624-055d130919eb req-14fe8eb7-9638-42c7-acda-e3323a3aa3e5 tempest-ServerStableDeviceRescueTest-1642713032 None] detach volume v_7fff5d89-4516-4be1-9698-f088498889ff from target iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:16:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-53e2dc12-049d-4b69-9624-055d130919eb req-14fe8eb7-9638-42c7-acda-e3323a3aa3e5 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff/luns/v_7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-53e2dc12-049d-4b69-9624-055d130919eb req-14fe8eb7-9638-42c7-acda-e3323a3aa3e5 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff/luns/v_7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:26 user cinder-volume[73403]: INFO cinder.volume.manager [None req-94bac0ea-c40d-4629-b160-37b2f3f71902 tempest-GroupSnapshotsTest-1003911629 None] group_snapshot 8015cc2d-675f-4467-8fe1-952732469a5a: created successfully Apr 14 03:16:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-53e2dc12-049d-4b69-9624-055d130919eb req-14fe8eb7-9638-42c7-acda-e3323a3aa3e5 tempest-ServerStableDeviceRescueTest-1642713032 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff/luns/v_7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-53e2dc12-049d-4b69-9624-055d130919eb req-14fe8eb7-9638-42c7-acda-e3323a3aa3e5 tempest-ServerStableDeviceRescueTest-1642713032 None] delete target: iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:16:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-53e2dc12-049d-4b69-9624-055d130919eb req-14fe8eb7-9638-42c7-acda-e3323a3aa3e5 tempest-ServerStableDeviceRescueTest-1642713032 None] delete target iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:16:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-53e2dc12-049d-4b69-9624-055d130919eb req-14fe8eb7-9638-42c7-acda-e3323a3aa3e5 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-53e2dc12-049d-4b69-9624-055d130919eb req-14fe8eb7-9638-42c7-acda-e3323a3aa3e5 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-53e2dc12-049d-4b69-9624-055d130919eb req-14fe8eb7-9638-42c7-acda-e3323a3aa3e5 tempest-ServerStableDeviceRescueTest-1642713032 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-53e2dc12-049d-4b69-9624-055d130919eb req-14fe8eb7-9638-42c7-acda-e3323a3aa3e5 tempest-ServerStableDeviceRescueTest-1642713032 None] target iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:16:28 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] group_snapshot 8015cc2d-675f-4467-8fe1-952732469a5a: deleting Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] group_snapshot 8015cc2d-675f-4467-8fe1-952732469a5a: deleting {{(pid=73403) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4304}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] deleating snapshot s_2270c3dd-8d4a-4057-b07d-080cee2829cb. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] get snapshots for volume s_2270c3dd-8d4a-4057-b07d-080cee2829cb {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2270c3dd-8d4a-4057-b07d-080cee2829cb/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2270c3dd-8d4a-4057-b07d-080cee2829cb/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2270c3dd-8d4a-4057-b07d-080cee2829cb/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] get volume s_2270c3dd-8d4a-4057-b07d-080cee2829cb info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2270c3dd-8d4a-4057-b07d-080cee2829cb {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2270c3dd-8d4a-4057-b07d-080cee2829cb {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_bca075b3-5d38-4359-b822-e71a1e9a122b@s_2270c3dd-8d4a-4057-b07d-080cee2829cb', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_2270c3dd-8d4a-4057-b07d-080cee2829cb', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443593', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113608', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5933338941410228507', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2054a7ea8faab5cd', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265055232', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86565', 'name': 's_2270c3dd-8d4a-4057-b07d-080cee2829cb', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2270c3dd-8d4a-4057-b07d-080cee2829cb {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] delete snapshot s_2270c3dd-8d4a-4057-b07d-080cee2829cb of volume v_bca075b3-5d38-4359-b822-e71a1e9a122b {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca075b3-5d38-4359-b822-e71a1e9a122b/snapshots/s_2270c3dd-8d4a-4057-b07d-080cee2829cb {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca075b3-5d38-4359-b822-e71a1e9a122b/snapshots/s_2270c3dd-8d4a-4057-b07d-080cee2829cb {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Flow 'volume_create_manager' (481f6387-59af-4fbe-8916-bb68431d6df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df090b1-24b0-4e6c-a99a-5a4c278c7988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df090b1-24b0-4e6c-a99a-5a4c278c7988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1037756980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c085bbc9-2123-4413-b363-e0bdff6f5774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e933f7c244d4d99b3fbf950a0d73606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:16:29Z,use_quota=True,user_id='cdac6467a80d40d58f192d0f1b6d3732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad930c56-5e90-47d2-8264-c515e3756120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad930c56-5e90-47d2-8264-c515e3756120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d24fa5-aad7-4c6a-848f-0a781bdbff6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d24fa5-aad7-4c6a-848f-0a781bdbff6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c085bbc9-2123-4413-b363-e0bdff6f5774', 'volume_name': 'volume-c085bbc9-2123-4413-b363-e0bdff6f5774', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ea28c1e-d1cb-4b27-b4f4-b1a5f7b87a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:28 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ea28c1e-d1cb-4b27-b4f4-b1a5f7b87a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab92993-8098-4c32-929c-b06b3a95d2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:29 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Volume c085bbc9-2123-4413-b363-e0bdff6f5774: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c085bbc9-2123-4413-b363-e0bdff6f5774', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 03:16:29 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Cloning c085bbc9-2123-4413-b363-e0bdff6f5774 from image 98e6a247-250b-4bb5-a947-e7f93598d16e at location (None, None). {{(pid=73403) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 03:16:29 user cinder-volume[73403]: DEBUG cinder.coordination [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Acquiring lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" by "_prepare_image_cache_entry" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:16:29 user cinder-volume[73403]: DEBUG cinder.coordination [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" acquired by "_prepare_image_cache_entry" :: waited 0.016s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:16:29 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 3, 16, 29, 26430)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 03:16:29 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 03:16:29 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Found cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 03:16:29 user cinder-volume[73403]: DEBUG cinder.coordination [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:16:29 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Attempting to retrieve cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 03:16:29 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 3, 16, 29, 40794)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 03:16:29 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 03:16:29 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Creating from source image-volume 482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 03:16:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] cloned volume 482f938f-083c-4221-99f8-3320a80b8725 to c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 03:16:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] cloning v_482f938f-083c-4221-99f8-3320a80b8725 to v_c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:16:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] create snapshot v_c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:16:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_c085bbc9-2123-4413-b363-e0bdff6f5774'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] create volume v_c085bbc9-2123-4413-b363-e0bdff6f5774 from snapshot v_c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:16:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca075b3-5d38-4359-b822-e71a1e9a122b/snapshots/s_2270c3dd-8d4a-4057-b07d-080cee2829cb {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] snapshot s_2270c3dd-8d4a-4057-b07d-080cee2829cb deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:16:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] deleating snapshot s_9e96a941-8899-4405-9d75-c6f3309e6967. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:16:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] get snapshots for volume s_9e96a941-8899-4405-9d75-c6f3309e6967 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:16:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9e96a941-8899-4405-9d75-c6f3309e6967/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9e96a941-8899-4405-9d75-c6f3309e6967/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9e96a941-8899-4405-9d75-c6f3309e6967/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] get volume s_9e96a941-8899-4405-9d75-c6f3309e6967 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:16:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9e96a941-8899-4405-9d75-c6f3309e6967 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9e96a941-8899-4405-9d75-c6f3309e6967 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c@s_9e96a941-8899-4405-9d75-c6f3309e6967', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_9e96a941-8899-4405-9d75-c6f3309e6967', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443595', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113619', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10540532296882748517', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b2a8236a2897ee7b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265042944', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86584', 'name': 's_9e96a941-8899-4405-9d75-c6f3309e6967', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9e96a941-8899-4405-9d75-c6f3309e6967 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] delete snapshot s_9e96a941-8899-4405-9d75-c6f3309e6967 of volume v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:16:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c/snapshots/s_9e96a941-8899-4405-9d75-c6f3309e6967 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c/snapshots/s_9e96a941-8899-4405-9d75-c6f3309e6967 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_c085bbc9-2123-4413-b363-e0bdff6f5774', 'is_clone': True, 'full_name': 'Pool-0/v_c085bbc9-2123-4413-b363-e0bdff6f5774', 'name': 'v_c085bbc9-2123-4413-b363-e0bdff6f5774'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] get volume v_c085bbc9-2123-4413-b363-e0bdff6f5774 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_c085bbc9-2123-4413-b363-e0bdff6f5774', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c085bbc9-2123-4413-b363-e0bdff6f5774', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443599', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '113629', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15054888354394221817', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3e3812a853cf63a8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265042944', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86817', 'name': 'v_c085bbc9-2123-4413-b363-e0bdff6f5774', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Marking volume c085bbc9-2123-4413-b363-e0bdff6f5774 as bootable. {{(pid=73403) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Copying metadata from image 98e6a247-250b-4bb5-a947-e7f93598d16e to c085bbc9-2123-4413-b363-e0bdff6f5774. {{(pid=73403) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Creating volume glance metadata for volume c085bbc9-2123-4413-b363-e0bdff6f5774 backed by image 98e6a247-250b-4bb5-a947-e7f93598d16e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73403) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab92993-8098-4c32-929c-b06b3a95d2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c085bbc9-2123-4413-b363-e0bdff6f5774', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (991f90b9-01ff-49df-9c20-f9a15f77388c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:31 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Volume volume-c085bbc9-2123-4413-b363-e0bdff6f5774 (c085bbc9-2123-4413-b363-e0bdff6f5774): created successfully Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (991f90b9-01ff-49df-9c20-f9a15f77388c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Flow 'volume_create_manager' (481f6387-59af-4fbe-8916-bb68431d6df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:16:31 user cinder-volume[73403]: INFO cinder.volume.manager [None req-461d05fa-bca5-4d8c-a5bf-83a8c159db98 tempest-VolumesCloneTest-1216328588 None] Created volume successfully. Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Flow 'volume_create_manager' (18e962d0-8584-47fe-876e-5b6480d15e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428cf792-02c7-4003-9bc4-e84110ccc681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428cf792-02c7-4003-9bc4-e84110ccc681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:31Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=46511b99-537b-43ba-af8f-65b70b89170b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2c5b2aafaf4ca7bf62e988ac726658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:16:31Z,use_quota=True,user_id='d666936eb0ee43a2ad9e17a12e6e273d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0e63c3-cee1-41f1-b908-f8905423f72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0e63c3-cee1-41f1-b908-f8905423f72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2157bc20-551d-4748-bcd4-cfa3f622062b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2157bc20-551d-4748-bcd4-cfa3f622062b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '46511b99-537b-43ba-af8f-65b70b89170b', 'volume_name': 'volume-46511b99-537b-43ba-af8f-65b70b89170b', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d6ea30-d50a-4456-9ee5-f28614050d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d6ea30-d50a-4456-9ee5-f28614050d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5531480-0077-4413-9474-7d9e6b402572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:31 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Volume 46511b99-537b-43ba-af8f-65b70b89170b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-46511b99-537b-43ba-af8f-65b70b89170b', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Cloning 46511b99-537b-43ba-af8f-65b70b89170b from image 98e6a247-250b-4bb5-a947-e7f93598d16e at location (None, None). {{(pid=73403) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.coordination [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Acquiring lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" by "_prepare_image_cache_entry" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.coordination [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.image.cache [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 3, 16, 31, 501951)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.image.cache [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Found cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.coordination [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" released by "_prepare_image_cache_entry" :: held 0.013s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Attempting to retrieve cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.image.cache [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 3, 16, 31, 515704)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.image.cache [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Creating from source image-volume 482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] cloned volume 482f938f-083c-4221-99f8-3320a80b8725 to 46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] cloning v_482f938f-083c-4221-99f8-3320a80b8725 to v_46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] create snapshot v_46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=76,cinder:UPDATE=16,cinder:INSERT=7,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Flow 'volume_create_manager' (f7eb0355-f7b5-4638-ac1f-2fbee8ff0bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c463e8e8-1ac3-4041-81cb-e5039cbd4cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c463e8e8-1ac3-4041-81cb-e5039cbd4cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-389793203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=eae4eeb7-cb81-4e50-8cc0-f84e9ecae555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e933f7c244d4d99b3fbf950a0d73606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c085bbc9-2123-4413-b363-e0bdff6f5774,status='creating',terminated_at=None,updated_at=2023-04-14T03:16:33Z,use_quota=True,user_id='cdac6467a80d40d58f192d0f1b6d3732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae7f7e9-6254-42ce-a4a7-a1ff2e3d3952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae7f7e9-6254-42ce-a4a7-a1ff2e3d3952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e71dcd5c-a6b5-49f1-8906-6824f740aa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c/snapshots/s_9e96a941-8899-4405-9d75-c6f3309e6967 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] snapshot s_9e96a941-8899-4405-9d75-c6f3309e6967 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e71dcd5c-a6b5-49f1-8906-6824f740aa50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'eae4eeb7-cb81-4e50-8cc0-f84e9ecae555', 'volume_name': 'volume-eae4eeb7-cb81-4e50-8cc0-f84e9ecae555', 'volume_size': 1, 'source_volid': 'c085bbc9-2123-4413-b363-e0bdff6f5774', 'source_volstatus': 'available'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0fd95f-0616-43d5-a294-259c7504c720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0fd95f-0616-43d5-a294-259c7504c720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc0e0a7-9422-46a9-91f8-3b7a3fc4ca55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:32 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Volume eae4eeb7-cb81-4e50-8cc0-f84e9ecae555: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-eae4eeb7-cb81-4e50-8cc0-f84e9ecae555', 'volume_size': 1, 'source_volid': 'c085bbc9-2123-4413-b363-e0bdff6f5774', 'source_volstatus': 'available'} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_46511b99-537b-43ba-af8f-65b70b89170b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] create volume v_46511b99-537b-43ba-af8f-65b70b89170b from snapshot v_46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] cloned volume c085bbc9-2123-4413-b363-e0bdff6f5774 to eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] cloning v_c085bbc9-2123-4413-b363-e0bdff6f5774 to v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] create snapshot v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c085bbc9-2123-4413-b363-e0bdff6f5774/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c085bbc9-2123-4413-b363-e0bdff6f5774/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:32 user cinder-volume[73403]: WARNING cinder.quota [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-422154924 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-422154924, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:16:32 user cinder-volume[73403]: WARNING cinder.quota [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-422154924 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-422154924, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:16:32 user cinder-volume[73403]: DEBUG cinder.quota [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Created reservations ['763608d1-05ff-4798-b5e1-63936bea372d', '05414ba4-3663-4f0e-bddf-3b41925a5cc4', '9bc946d4-44c6-4284-b3f5-060c40c7bd39', 'f411a930-9554-41f4-a3c4-821b4892e33b'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:16:33 user cinder-volume[73403]: DEBUG cinder.quota [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] Created reservations ['d1dfc552-0232-4df4-8ae3-4441592622ff', 'ffbb1add-b58f-4e07-a7d0-c8e6e48b1247', 'dcb302ee-be80-43e1-80c2-521b213a78ad', '3cae6531-40f4-4b4f-b878-6e918249f83b'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:16:33 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a183f5c3-b135-44b5-8539-3c344a04cae8 tempest-GroupSnapshotsTest-1003911629 None] group_snapshot 8015cc2d-675f-4467-8fe1-952732469a5a: deleted successfully Apr 14 03:16:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_46511b99-537b-43ba-af8f-65b70b89170b', 'is_clone': True, 'full_name': 'Pool-0/v_46511b99-537b-43ba-af8f-65b70b89170b', 'name': 'v_46511b99-537b-43ba-af8f-65b70b89170b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] get volume v_46511b99-537b-43ba-af8f-65b70b89170b info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:16:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_46511b99-537b-43ba-af8f-65b70b89170b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_46511b99-537b-43ba-af8f-65b70b89170b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443602', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '113640', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14540729680004774980', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1b223f65a0bbc8aa', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114264981504', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86007', 'name': 'v_46511b99-537b-43ba-af8f-65b70b89170b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:33 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Marking volume 46511b99-537b-43ba-af8f-65b70b89170b as bootable. {{(pid=73403) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 03:16:33 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Copying metadata from image 98e6a247-250b-4bb5-a947-e7f93598d16e to 46511b99-537b-43ba-af8f-65b70b89170b. {{(pid=73403) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 03:16:33 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Creating volume glance metadata for volume 46511b99-537b-43ba-af8f-65b70b89170b backed by image 98e6a247-250b-4bb5-a947-e7f93598d16e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73403) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 03:16:33 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5531480-0077-4413-9474-7d9e6b402572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46511b99-537b-43ba-af8f-65b70b89170b', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:33 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93d7790-ddc1-4373-9c3b-d17906d2802f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:33 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=68,cinder:UPDATE=17,cinder:INSERT=15 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:33 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Volume volume-46511b99-537b-43ba-af8f-65b70b89170b (46511b99-537b-43ba-af8f-65b70b89170b): created successfully Apr 14 03:16:33 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93d7790-ddc1-4373-9c3b-d17906d2802f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:33 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Flow 'volume_create_manager' (18e962d0-8584-47fe-876e-5b6480d15e38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:16:33 user cinder-volume[73403]: INFO cinder.volume.manager [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-f79e9798-7a4f-400c-9819-02bd14e530a8 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Created volume successfully. Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] remove_export for volume: b19d5a1c-cf0f-4da6-96f7-918897c16c6c. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-523090251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e3e6fd2a-575b-4505-aada-5c9afba0d6c4,host='user@joviandss-2#joviandss-2',id=b19d5a1c-cf0f-4da6-96f7-918897c16c6c,launched_at=2023-04-14T03:16:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0d5639765ed45e9b679f038a2775982',provider_auth='CHAP nHGLcJjK PxcmziQ10Hle2G',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b19d5a1c-cf0f-4da6-96f7-918897c16c6c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:12Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T03:16:34Z,use_quota=True,user_id='177ee2ef30a24897a01a934cd31c755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12d23ce1-e801-4540-9c6f-67fddfbbccd6),volume_type_id=12d23ce1-e801-4540-9c6f-67fddfbbccd6) from target:iqn.2010-10.org.openstack:b19d5a1c-cf0f-4da6-96f7-918897c16c6c. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] detach volume v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c from target iqn.2010-10.org.openstack:b19d5a1c-cf0f-4da6-96f7-918897c16c6c {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b19d5a1c-cf0f-4da6-96f7-918897c16c6c/luns/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b19d5a1c-cf0f-4da6-96f7-918897c16c6c/luns/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b19d5a1c-cf0f-4da6-96f7-918897c16c6c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b19d5a1c-cf0f-4da6-96f7-918897c16c6c/luns/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b19d5a1c-cf0f-4da6-96f7-918897c16c6c/luns/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] failed to remove resource iqn.2010-10.org.openstack:b19d5a1c-cf0f-4da6-96f7-918897c16c6c because of JDSS resource v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] delete target: iqn.2010-10.org.openstack:b19d5a1c-cf0f-4da6-96f7-918897c16c6c {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] delete target iqn.2010-10.org.openstack:b19d5a1c-cf0f-4da6-96f7-918897c16c6c {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b19d5a1c-cf0f-4da6-96f7-918897c16c6c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b19d5a1c-cf0f-4da6-96f7-918897c16c6c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b19d5a1c-cf0f-4da6-96f7-918897c16c6c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b19d5a1c-cf0f-4da6-96f7-918897c16c6c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b19d5a1c-cf0f-4da6-96f7-918897c16c6c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] failed to remove resource iqn.2010-10.org.openstack:b19d5a1c-cf0f-4da6-96f7-918897c16c6c because of JDSS resource iqn.2010-10.org.openstack:b19d5a1c-cf0f-4da6-96f7-918897c16c6c DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] deleating volume v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] get snapshots for volume v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c085bbc9-2123-4413-b363-e0bdff6f5774/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] create volume v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 from snapshot v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c085bbc9-2123-4413-b363-e0bdff6f5774/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c085bbc9-2123-4413-b363-e0bdff6f5774/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] get volume v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443581', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113594', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4265502510673157018', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4924e0ab6cfb9c9a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114264944640', 'san:volume_id': '4924e0ab6cfb9c9ada79ecaf3600f0af09fa4ad1', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86542', 'name': 'v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] delete volume:v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c085bbc9-2123-4413-b363-e0bdff6f5774@v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555', 'is_clone': True, 'full_name': 'Pool-0/v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555', 'name': 'v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c085bbc9-2123-4413-b363-e0bdff6f5774/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] get volume v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c085bbc9-2123-4413-b363-e0bdff6f5774@v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443603', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '113645', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8638920581237422091', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a5fad72e42e7b29d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114264944640', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86329', 'name': 'v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Marking volume eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 as bootable. {{(pid=73403) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Copying metadata from source volume c085bbc9-2123-4413-b363-e0bdff6f5774 to eae4eeb7-cb81-4e50-8cc0-f84e9ecae555. {{(pid=73403) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:440}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc0e0a7-9422-46a9-91f8-3b7a3fc4ca55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eae4eeb7-cb81-4e50-8cc0-f84e9ecae555', 'volume_size': 1, 'source_volid': 'c085bbc9-2123-4413-b363-e0bdff6f5774', 'source_volstatus': 'available'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba58291d-d43e-4cf3-ac58-8e7a8f39cb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:35 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Volume volume-eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 (eae4eeb7-cb81-4e50-8cc0-f84e9ecae555): created successfully Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba58291d-d43e-4cf3-ac58-8e7a8f39cb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Flow 'volume_create_manager' (f7eb0355-f7b5-4638-ac1f-2fbee8ff0bd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:16:35 user cinder-volume[73403]: INFO cinder.volume.manager [None req-7fdd1b2d-0be1-4142-8f42-ce54b14526f3 tempest-VolumesCloneTest-1216328588 None] Created volume successfully. Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Acquiring lock "cinder-c6fbfee2-70fa-477a-a761-8d092061e691-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-c6fbfee2-70fa-477a-a761-8d092061e691-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] remove_export for volume: c6fbfee2-70fa-477a-a761-8d092061e691. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1818179131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c6fbfee2-70fa-477a-a761-8d092061e691,launched_at=2023-04-14T03:08:04Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2e49e8e92e416faebf55e3d4e0e087',provider_auth='CHAP tekamKoO sDhWrA2PuO1ceX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:08:01Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:16:35Z,updated_at=2023-04-14T03:16:35Z,use_quota=True,user_id='60e11b7ab2914209b23bf7a53791da64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] detach volume v_c6fbfee2-70fa-477a-a761-8d092061e691 from target iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/luns/v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/luns/v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/luns/v_c6fbfee2-70fa-477a-a761-8d092061e691'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691/luns/v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] failed to remove resource iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 because of JDSS resource v_c6fbfee2-70fa-477a-a761-8d092061e691 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] delete target: iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] delete target iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] failed to remove resource iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 because of JDSS resource iqn.2010-10.org.openstack:c6fbfee2-70fa-477a-a761-8d092061e691 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] deleating volume v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] get snapshots for volume v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6fbfee2-70fa-477a-a761-8d092061e691/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6fbfee2-70fa-477a-a761-8d092061e691/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.coordination [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Acquiring lock "cinder-eae4eeb7-cb81-4e50-8cc0-f84e9ecae555-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.coordination [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Lock "cinder-eae4eeb7-cb81-4e50-8cc0-f84e9ecae555-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] remove_export for volume: eae4eeb7-cb81-4e50-8cc0-f84e9ecae555. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-389793203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=eae4eeb7-cb81-4e50-8cc0-f84e9ecae555,launched_at=2023-04-14T03:16:35Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e933f7c244d4d99b3fbf950a0d73606',provider_auth='CHAP kSbEmidO EtckldK6CsXSLv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:33Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c085bbc9-2123-4413-b363-e0bdff6f5774,status='deleting',terminated_at=2023-04-14T03:16:36Z,updated_at=2023-04-14T03:16:36Z,use_quota=True,user_id='cdac6467a80d40d58f192d0f1b6d3732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:eae4eeb7-cb81-4e50-8cc0-f84e9ecae555. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] detach volume v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 from target iqn.2010-10.org.openstack:eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eae4eeb7-cb81-4e50-8cc0-f84e9ecae555/luns/v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eae4eeb7-cb81-4e50-8cc0-f84e9ecae555/luns/v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6fbfee2-70fa-477a-a761-8d092061e691/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] get volume v_c6fbfee2-70fa-477a-a761-8d092061e691 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eae4eeb7-cb81-4e50-8cc0-f84e9ecae555/luns/v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eae4eeb7-cb81-4e50-8cc0-f84e9ecae555/luns/v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] failed to remove resource iqn.2010-10.org.openstack:eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 because of JDSS resource v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] delete target: iqn.2010-10.org.openstack:eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] delete target iqn.2010-10.org.openstack:eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_c6fbfee2-70fa-477a-a761-8d092061e691', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c6fbfee2-70fa-477a-a761-8d092061e691', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443091', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26116096', 'sharesmb': None, 'createtxg': '113111', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2928358237745687671', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10137600', 'logicalused': '26030080', 'compressratio': '2.58', 'rootcontext': 'none', 'default_scsi_id': '432cad81504b77c1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265001984', 'san:volume_id': '432cad81504b77c1c33b5ad08508a0fe3cbb3ef7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10137600', 'objsetid': '86165', 'name': 'v_c6fbfee2-70fa-477a-a761-8d092061e691', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10137600', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] delete snapshot v_c6fbfee2-70fa-477a-a761-8d092061e691 of volume v_482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eae4eeb7-cb81-4e50-8cc0-f84e9ecae555'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] failed to remove resource iqn.2010-10.org.openstack:eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 because of JDSS resource iqn.2010-10.org.openstack:eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] deleating volume v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] get snapshots for volume v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] get volume v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_c085bbc9-2123-4413-b363-e0bdff6f5774@v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443603', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '113645', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8638920581237422091', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a5fad72e42e7b29d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265001984', 'san:volume_id': 'a5fad72e42e7b29d8097af69d0a7747c089f1980', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86329', 'name': 'v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] delete snapshot v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 of volume v_c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c085bbc9-2123-4413-b363-e0bdff6f5774/snapshots/v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c085bbc9-2123-4413-b363-e0bdff6f5774/snapshots/v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] volume v_b19d5a1c-cf0f-4da6-96f7-918897c16c6c deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] remove_export for volume: bca075b3-5d38-4359-b822-e71a1e9a122b. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-884205491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e3e6fd2a-575b-4505-aada-5c9afba0d6c4,host='user@joviandss-2#joviandss-2',id=bca075b3-5d38-4359-b822-e71a1e9a122b,launched_at=2023-04-14T03:16:16Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0d5639765ed45e9b679f038a2775982',provider_auth='CHAP yDfPbWws meMZfUpcDHk4sN',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca075b3-5d38-4359-b822-e71a1e9a122b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:15Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T03:16:34Z,use_quota=True,user_id='177ee2ef30a24897a01a934cd31c755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12d23ce1-e801-4540-9c6f-67fddfbbccd6),volume_type_id=12d23ce1-e801-4540-9c6f-67fddfbbccd6) from target:iqn.2010-10.org.openstack:bca075b3-5d38-4359-b822-e71a1e9a122b. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] detach volume v_bca075b3-5d38-4359-b822-e71a1e9a122b from target iqn.2010-10.org.openstack:bca075b3-5d38-4359-b822-e71a1e9a122b {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca075b3-5d38-4359-b822-e71a1e9a122b/luns/v_bca075b3-5d38-4359-b822-e71a1e9a122b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca075b3-5d38-4359-b822-e71a1e9a122b/luns/v_bca075b3-5d38-4359-b822-e71a1e9a122b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] create export for volume: 46511b99-537b-43ba-af8f-65b70b89170b. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] ensure volume 46511b99-537b-43ba-af8f-65b70b89170b assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] check if targe iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bca075b3-5d38-4359-b822-e71a1e9a122b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca075b3-5d38-4359-b822-e71a1e9a122b/luns/v_bca075b3-5d38-4359-b822-e71a1e9a122b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca075b3-5d38-4359-b822-e71a1e9a122b/luns/v_bca075b3-5d38-4359-b822-e71a1e9a122b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] failed to remove resource iqn.2010-10.org.openstack:bca075b3-5d38-4359-b822-e71a1e9a122b because of JDSS resource v_bca075b3-5d38-4359-b822-e71a1e9a122b DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] delete target: iqn.2010-10.org.openstack:bca075b3-5d38-4359-b822-e71a1e9a122b {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] delete target iqn.2010-10.org.openstack:bca075b3-5d38-4359-b822-e71a1e9a122b {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca075b3-5d38-4359-b822-e71a1e9a122b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca075b3-5d38-4359-b822-e71a1e9a122b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bca075b3-5d38-4359-b822-e71a1e9a122b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca075b3-5d38-4359-b822-e71a1e9a122b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca075b3-5d38-4359-b822-e71a1e9a122b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] failed to remove resource iqn.2010-10.org.openstack:bca075b3-5d38-4359-b822-e71a1e9a122b because of JDSS resource iqn.2010-10.org.openstack:bca075b3-5d38-4359-b822-e71a1e9a122b DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] deleating volume v_bca075b3-5d38-4359-b822-e71a1e9a122b {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] get snapshots for volume v_bca075b3-5d38-4359-b822-e71a1e9a122b {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca075b3-5d38-4359-b822-e71a1e9a122b/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca075b3-5d38-4359-b822-e71a1e9a122b/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] create target and attach volume 46511b99-537b-43ba-af8f-65b70b89170b to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] create target iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca075b3-5d38-4359-b822-e71a1e9a122b/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] get volume v_bca075b3-5d38-4359-b822-e71a1e9a122b info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:16:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca075b3-5d38-4359-b822-e71a1e9a122b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca075b3-5d38-4359-b822-e71a1e9a122b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_bca075b3-5d38-4359-b822-e71a1e9a122b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443584', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113598', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16583352458160703572', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '333f856849db55be', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275237888', 'san:volume_id': '333f856849db55be4875c563a4d3c93d820dd385', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86551', 'name': 'v_bca075b3-5d38-4359-b822-e71a1e9a122b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca075b3-5d38-4359-b822-e71a1e9a122b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] delete volume:v_bca075b3-5d38-4359-b822-e71a1e9a122b recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:16:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca075b3-5d38-4359-b822-e71a1e9a122b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca075b3-5d38-4359-b822-e71a1e9a122b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_c6fbfee2-70fa-477a-a761-8d092061e691 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] snapshot v_c6fbfee2-70fa-477a-a761-8d092061e691 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:16:37 user cinder-volume[73403]: DEBUG cinder.quota [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Created reservations ['3892c88d-9538-49cb-96a6-76b1e468d430', '544475f4-1776-4b9b-9ed8-c4307c1e8d6d', 'd3631b5c-e210-48c6-9361-53de34caaba1', '99dadf02-00c1-4433-8196-63f611980cfa'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:16:37 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=53,cinder:UPDATE=26,cinder:INSERT=21 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:16:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:16:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c085bbc9-2123-4413-b363-e0bdff6f5774/snapshots/v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] snapshot v_eae4eeb7-cb81-4e50-8cc0-f84e9ecae555 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:16:38 user cinder-volume[73403]: DEBUG cinder.quota [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Created reservations ['0f0fed33-39bb-46c5-abba-21e733230560', 'bf8684e2-cfab-4dd4-887f-2eaf6b28c6c2', '945ed910-59c5-4345-9ae6-f357989aef8e', '180f6915-3739-48ef-9dcf-d6b3872b51cd'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:16:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:16:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:16:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'available': '114265092096', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:16:38 user cinder-volume[73403]: DEBUG cinder.manager [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:16:38 user cinder-volume[73403]: INFO cinder.volume.manager [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Deleted volume successfully. Apr 14 03:16:38 user cinder-volume[73403]: DEBUG cinder.coordination [None req-aef44569-1779-48b2-ae71-077b15e54610 tempest-VolumesCloneTest-1216328588 None] Lock "cinder-eae4eeb7-cb81-4e50-8cc0-f84e9ecae555-delete_volume" released by "delete_volume" :: held 2.671s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:16:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Geting {'code': 200, 'error': None, 'data': {'available': '114275250176', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:16:38 user cinder-volume[73403]: DEBUG cinder.manager [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:16:38 user cinder-volume[73403]: INFO cinder.volume.manager [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Deleted volume successfully. Apr 14 03:16:38 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5aa4347e-7cd2-4e7a-a69a-2ac25a05e690 tempest-TestVolumeBootPattern-910285030 None] Lock "cinder-c6fbfee2-70fa-477a-a761-8d092061e691-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca075b3-5d38-4359-b822-e71a1e9a122b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] volume v_bca075b3-5d38-4359-b822-e71a1e9a122b deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Acquiring lock "cinder-c085bbc9-2123-4413-b363-e0bdff6f5774-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Lock "cinder-c085bbc9-2123-4413-b363-e0bdff6f5774-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] remove_export for volume: c085bbc9-2123-4413-b363-e0bdff6f5774. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1037756980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c085bbc9-2123-4413-b363-e0bdff6f5774,launched_at=2023-04-14T03:16:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e933f7c244d4d99b3fbf950a0d73606',provider_auth='CHAP QZKYrHiF YV2ZsrIl4v8iHt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c085bbc9-2123-4413-b363-e0bdff6f5774 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:29Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:16:39Z,updated_at=2023-04-14T03:16:39Z,use_quota=True,user_id='cdac6467a80d40d58f192d0f1b6d3732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:c085bbc9-2123-4413-b363-e0bdff6f5774. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] detach volume v_c085bbc9-2123-4413-b363-e0bdff6f5774 from target iqn.2010-10.org.openstack:c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c085bbc9-2123-4413-b363-e0bdff6f5774/luns/v_c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c085bbc9-2123-4413-b363-e0bdff6f5774/luns/v_c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.quota [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Created reservations ['878b5071-9372-4dcd-9538-85950b0a2ee1'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:16:39 user cinder-volume[73403]: WARNING cinder.quota [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-422154924 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-422154924, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c085bbc9-2123-4413-b363-e0bdff6f5774 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c085bbc9-2123-4413-b363-e0bdff6f5774/luns/v_c085bbc9-2123-4413-b363-e0bdff6f5774'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c085bbc9-2123-4413-b363-e0bdff6f5774/luns/v_c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] failed to remove resource iqn.2010-10.org.openstack:c085bbc9-2123-4413-b363-e0bdff6f5774 because of JDSS resource v_c085bbc9-2123-4413-b363-e0bdff6f5774 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] delete target: iqn.2010-10.org.openstack:c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] delete target iqn.2010-10.org.openstack:c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.quota [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Created reservations ['322eff15-2521-4ca9-b9a9-2428d37eb51a', 'c97c6a2b-cd85-459b-848b-d232b4ce8053', 'cd0d2cb0-988c-4dbf-9dee-ad2290a63a95', 'dd566750-9ab4-4dd0-bc49-01b876959a77'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c085bbc9-2123-4413-b363-e0bdff6f5774 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c085bbc9-2123-4413-b363-e0bdff6f5774'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] failed to remove resource iqn.2010-10.org.openstack:c085bbc9-2123-4413-b363-e0bdff6f5774 because of JDSS resource iqn.2010-10.org.openstack:c085bbc9-2123-4413-b363-e0bdff6f5774 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] deleating volume v_c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] get snapshots for volume v_c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c085bbc9-2123-4413-b363-e0bdff6f5774/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c085bbc9-2123-4413-b363-e0bdff6f5774/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=54,cinder:DELETE=2,cinder:INSERT=13,cinder:UPDATE=31 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.quota [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Created reservations ['0aef1a60-7269-4036-ad37-87fb612bf279', '5458a752-2a75-4f52-bf63-66afedf963b8', '10f416df-d260-4847-a6dd-9378588d699b', '5a69432f-e617-406a-b933-9b162fccc02a'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] atach volume v_46511b99-537b-43ba-af8f-65b70b89170b to target iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c085bbc9-2123-4413-b363-e0bdff6f5774/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] get volume v_c085bbc9-2123-4413-b363-e0bdff6f5774 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:16:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_c085bbc9-2123-4413-b363-e0bdff6f5774', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c085bbc9-2123-4413-b363-e0bdff6f5774', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443599', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '113629', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15054888354394221817', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3e3812a853cf63a8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275319808', 'san:volume_id': '3e3812a853cf63a8d41a89da7049b493ade7c277', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86817', 'name': 'v_c085bbc9-2123-4413-b363-e0bdff6f5774', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] delete snapshot v_c085bbc9-2123-4413-b363-e0bdff6f5774 of volume v_482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:16:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'available': '114275319808', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:16:40 user cinder-volume[73403]: DEBUG cinder.manager [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:16:40 user cinder-volume[73403]: INFO cinder.volume.manager [None req-b4fe2bf7-f4f6-42e4-8c6c-7dea8401bfd7 tempest-GroupSnapshotsTest-1003911629 None] Delete group completed successfully. Apr 14 03:16:41 user cinder-volume[73403]: INFO cinder.volume.manager [None req-9e6a234f-54c8-43c3-a4f9-baa47e26569f tempest-GroupSnapshotsTest-1003911629 None] Group tempest-GroupSnapshotsTest-Group-806880449: creating Apr 14 03:16:41 user cinder-volume[73403]: INFO cinder.volume.manager [None req-9e6a234f-54c8-43c3-a4f9-baa47e26569f tempest-GroupSnapshotsTest-1003911629 None] Group tempest-GroupSnapshotsTest-Group-806880449: created successfully Apr 14 03:16:41 user cinder-volume[73403]: INFO cinder.volume.manager [None req-9e6a234f-54c8-43c3-a4f9-baa47e26569f tempest-GroupSnapshotsTest-1003911629 None] Create group completed successfully. Apr 14 03:16:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3162323233663635', 'lun': 0, 'mode': 'wt', 'name': 'v_46511b99-537b-43ba-af8f-65b70b89170b', 'prod_id': 'Storage', 'scsi_id': '1b223f65a0bbc8aa'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] add credentails to target iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:16:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Geting {'code': 201, 'error': None, 'data': {'name': 'cwEYTBpt'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] initialize_connection for 46511b99-537b-43ba-af8f-65b70b89170b 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:16:41 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cwEYTBpt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'a5bbbb1b-897b-41af-817a-9723fbeb8547'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:16:41 user cinder-volume[73403]: INFO cinder.volume.manager [req-076fc63b-a749-44f2-93ec-0f5c9b727ece req-0dd9d9c7-9c4e-42de-8909-43eda5f214aa tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] attachment_update completed successfully. Apr 14 03:16:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_c085bbc9-2123-4413-b363-e0bdff6f5774 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] snapshot v_c085bbc9-2123-4413-b363-e0bdff6f5774 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:16:41 user cinder-volume[73403]: DEBUG cinder.quota [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Created reservations ['ecdefd15-0fa7-4092-8e9b-444115a8c53f', '358ccd5c-38a4-4bb9-be7a-62002571ab9a', '40c53989-f3d6-4353-a6d7-6d1eb67916c4', 'b5309f78-b67b-435a-9652-d101c81da97b'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:16:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:16:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:16:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'available': '114275344384', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:16:42 user cinder-volume[73403]: DEBUG cinder.manager [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:16:42 user cinder-volume[73403]: INFO cinder.volume.manager [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Deleted volume successfully. Apr 14 03:16:42 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=34,cinder:SELECT=54,cinder:INSERT=9,cinder:DELETE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:42 user cinder-volume[73403]: DEBUG cinder.coordination [None req-5b0333ef-c894-4ab1-af86-30f66adc7632 tempest-VolumesCloneTest-1216328588 None] Lock "cinder-c085bbc9-2123-4413-b363-e0bdff6f5774-delete_volume" released by "delete_volume" :: held 3.360s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:16:42 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:16:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Flow 'volume_create_manager' (41a3d2bb-c654-4580-8823-08785a80629c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:16:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ed2213-4d6a-4df8-895b-84dcb20a583b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ed2213-4d6a-4df8-895b-84dcb20a583b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-203377311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=baf5936f-0ae9-4a0e-b3e5-1a315f57921f,host='user@joviandss-2#joviandss-2',id=32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0d5639765ed45e9b679f038a2775982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:16:43Z,use_quota=True,user_id='177ee2ef30a24897a01a934cd31c755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77d6455a-ae04-4c33-904e-2db605d32f67),volume_type_id=77d6455a-ae04-4c33-904e-2db605d32f67)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b576bee9-fb2e-4d48-9002-db5751850f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b576bee9-fb2e-4d48-9002-db5751850f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a660427-4786-48a5-90c5-c5b1d9d70946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a660427-4786-48a5-90c5-c5b1d9d70946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f', 'volume_name': 'volume-32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c672e4-07bd-48c9-9d18-880d6ce8172f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c672e4-07bd-48c9-9d18-880d6ce8172f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840be439-5b28-4af4-86e9-5b9970880790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:42 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Volume 32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f', 'volume_size': 1} Apr 14 03:16:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] creating volume v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:16:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] create volume {'name': 'v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:16:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:42 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:16:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Flow 'volume_create_manager' (d2e0a6f1-2320-4990-8a59-be6681a0d85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:16:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa253b55-5ce3-4159-aeed-866292f5f82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa253b55-5ce3-4159-aeed-866292f5f82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-332024026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=61a46c7e-5d8c-4650-a7d6-38bbb80200e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e933f7c244d4d99b3fbf950a0d73606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:16:43Z,use_quota=True,user_id='cdac6467a80d40d58f192d0f1b6d3732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (814b6693-3120-4409-819b-4e46e0917aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (814b6693-3120-4409-819b-4e46e0917aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6b3499-2fbe-473d-ad0e-ebe5ec74c8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6b3499-2fbe-473d-ad0e-ebe5ec74c8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61a46c7e-5d8c-4650-a7d6-38bbb80200e4', 'volume_name': 'volume-61a46c7e-5d8c-4650-a7d6-38bbb80200e4', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1508d9ae-2d3a-4218-8a00-d036c7fa4a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1508d9ae-2d3a-4218-8a00-d036c7fa4a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ac40e1-45af-485f-806c-3eb60cdd9a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:43 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Volume 61a46c7e-5d8c-4650-a7d6-38bbb80200e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61a46c7e-5d8c-4650-a7d6-38bbb80200e4', 'volume_size': 1} Apr 14 03:16:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] creating volume v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:16:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] create volume {'name': 'v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:16:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f', 'is_clone': False, 'name': 'v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840be439-5b28-4af4-86e9-5b9970880790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (822186a5-84ef-4cba-aac3-631899b23bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:43 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Volume volume-32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f (32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f): created successfully Apr 14 03:16:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (822186a5-84ef-4cba-aac3-631899b23bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Flow 'volume_create_manager' (41a3d2bb-c654-4580-8823-08785a80629c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:16:43 user cinder-volume[73403]: INFO cinder.volume.manager [None req-f178faee-10d3-4bf0-bbfa-328303b8d63e tempest-GroupSnapshotsTest-1003911629 None] Created volume successfully. Apr 14 03:16:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4', 'is_clone': False, 'name': 'v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ac40e1-45af-485f-806c-3eb60cdd9a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61a46c7e-5d8c-4650-a7d6-38bbb80200e4', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bac3569c-99a6-4744-8dfe-3f98013ce382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:44 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Volume volume-61a46c7e-5d8c-4650-a7d6-38bbb80200e4 (61a46c7e-5d8c-4650-a7d6-38bbb80200e4): created successfully Apr 14 03:16:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bac3569c-99a6-4744-8dfe-3f98013ce382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Flow 'volume_create_manager' (d2e0a6f1-2320-4990-8a59-be6681a0d85f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:16:44 user cinder-volume[73403]: INFO cinder.volume.manager [None req-0aa74ef2-0efd-4827-8f3b-1f106aaded7c tempest-VolumesCloneTest-1216328588 None] Created volume successfully. Apr 14 03:16:45 user cinder-volume[73403]: INFO cinder.volume.manager [None req-abe7b53c-fab8-4d01-ad2e-997a07861d90 tempest-GroupSnapshotsTest-1003911629 None] GroupSnapshot cdd9c788-883a-41c3-af0a-6fb4be2c9d11: creating. Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-abe7b53c-fab8-4d01-ad2e-997a07861d90 tempest-GroupSnapshotsTest-1003911629 None] Group snapshot cdd9c788-883a-41c3-af0a-6fb4be2c9d11: creating. {{(pid=73403) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4129}} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-abe7b53c-fab8-4d01-ad2e-997a07861d90 tempest-GroupSnapshotsTest-1003911629 None] create snapshot b189d838-64d1-4fe7-8ef8-2601adbe8c7c for volume 32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-abe7b53c-fab8-4d01-ad2e-997a07861d90 tempest-GroupSnapshotsTest-1003911629 None] cloning v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f to s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-abe7b53c-fab8-4d01-ad2e-997a07861d90 tempest-GroupSnapshotsTest-1003911629 None] create snapshot s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abe7b53c-fab8-4d01-ad2e-997a07861d90 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abe7b53c-fab8-4d01-ad2e-997a07861d90 tempest-GroupSnapshotsTest-1003911629 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Flow 'volume_create_manager' (a1c1e51c-717e-4edc-bfbf-3bbd97f18a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (753394e7-c204-4a7c-aeb4-cc6c599509c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (753394e7-c204-4a7c-aeb4-cc6c599509c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1453617397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d4562147-b303-4f3d-b237-e8a24dd63a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e933f7c244d4d99b3fbf950a0d73606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=61a46c7e-5d8c-4650-a7d6-38bbb80200e4,status='creating',terminated_at=None,updated_at=2023-04-14T03:16:45Z,use_quota=True,user_id='cdac6467a80d40d58f192d0f1b6d3732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f852a03-f955-4e31-a895-0c6d4835eb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f852a03-f955-4e31-a895-0c6d4835eb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f98d5ff-737a-4274-abec-229bb081371b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f98d5ff-737a-4274-abec-229bb081371b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd4562147-b303-4f3d-b237-e8a24dd63a70', 'volume_name': 'volume-d4562147-b303-4f3d-b237-e8a24dd63a70', 'volume_size': 2, 'source_volid': '61a46c7e-5d8c-4650-a7d6-38bbb80200e4', 'source_volstatus': 'available'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ecd4f84-3f9f-4fff-b003-ce2a038233cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ecd4f84-3f9f-4fff-b003-ce2a038233cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1620377-82c7-4098-9592-c197e1fed9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:45 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Volume d4562147-b303-4f3d-b237-e8a24dd63a70: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d4562147-b303-4f3d-b237-e8a24dd63a70', 'volume_size': 2, 'source_volid': '61a46c7e-5d8c-4650-a7d6-38bbb80200e4', 'source_volstatus': 'available'} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] cloned volume 61a46c7e-5d8c-4650-a7d6-38bbb80200e4 to d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] cloning v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4 to v_d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] create snapshot v_d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abe7b53c-fab8-4d01-ad2e-997a07861d90 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_b189d838-64d1-4fe7-8ef8-2601adbe8c7c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-abe7b53c-fab8-4d01-ad2e-997a07861d90 tempest-GroupSnapshotsTest-1003911629 None] create volume s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c from snapshot s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:16:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abe7b53c-fab8-4d01-ad2e-997a07861d90 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abe7b53c-fab8-4d01-ad2e-997a07861d90 tempest-GroupSnapshotsTest-1003911629 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_d4562147-b303-4f3d-b237-e8a24dd63a70'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] create volume v_d4562147-b303-4f3d-b237-e8a24dd63a70 from snapshot v_d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:16:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abe7b53c-fab8-4d01-ad2e-997a07861d90 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f@s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c', 'is_clone': True, 'full_name': 'Pool-0/s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c', 'name': 's_b189d838-64d1-4fe7-8ef8-2601adbe8c7c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abe7b53c-fab8-4d01-ad2e-997a07861d90 tempest-GroupSnapshotsTest-1003911629 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abe7b53c-fab8-4d01-ad2e-997a07861d90 tempest-GroupSnapshotsTest-1003911629 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abe7b53c-fab8-4d01-ad2e-997a07861d90 tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-abe7b53c-fab8-4d01-ad2e-997a07861d90 tempest-GroupSnapshotsTest-1003911629 None] volume s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:16:47 user cinder-volume[73403]: INFO cinder.volume.manager [None req-abe7b53c-fab8-4d01-ad2e-997a07861d90 tempest-GroupSnapshotsTest-1003911629 None] group_snapshot cdd9c788-883a-41c3-af0a-6fb4be2c9d11: created successfully Apr 14 03:16:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4@v_d4562147-b303-4f3d-b237-e8a24dd63a70', 'is_clone': True, 'full_name': 'Pool-0/v_d4562147-b303-4f3d-b237-e8a24dd63a70', 'name': 'v_d4562147-b303-4f3d-b237-e8a24dd63a70'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] get volume v_d4562147-b303-4f3d-b237-e8a24dd63a70 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:16:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4@v_d4562147-b303-4f3d-b237-e8a24dd63a70', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d4562147-b303-4f3d-b237-e8a24dd63a70', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443615', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113678', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4291387024875421135', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e5f178a032bacf50', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275143680', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86930', 'name': 'v_d4562147-b303-4f3d-b237-e8a24dd63a70', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Extend volume d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}} Apr 14 03:16:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] jdss extend volume v_d4562147-b303-4f3d-b237-e8a24dd63a70 to 2147483648 {{(pid=73403) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}} Apr 14 03:16:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1620377-82c7-4098-9592-c197e1fed9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4562147-b303-4f3d-b237-e8a24dd63a70', 'volume_size': 2, 'source_volid': '61a46c7e-5d8c-4650-a7d6-38bbb80200e4', 'source_volstatus': 'available'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3dba15-e183-418c-b86c-a671980fc137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:48 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Volume volume-d4562147-b303-4f3d-b237-e8a24dd63a70 (d4562147-b303-4f3d-b237-e8a24dd63a70): created successfully Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3dba15-e183-418c-b86c-a671980fc137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Flow 'volume_create_manager' (a1c1e51c-717e-4edc-bfbf-3bbd97f18a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:16:48 user cinder-volume[73403]: INFO cinder.volume.manager [None req-17e20f58-b27e-454b-b007-48ebb4f0d840 tempest-VolumesCloneTest-1216328588 None] Created volume successfully. Apr 14 03:16:48 user cinder-volume[73403]: INFO cinder.volume.manager [None req-887c48fc-2832-4b60-aff9-d6d7ac53b8fd tempest-GroupSnapshotsTest-1003911629 None] group_snapshot cdd9c788-883a-41c3-af0a-6fb4be2c9d11: deleting Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-887c48fc-2832-4b60-aff9-d6d7ac53b8fd tempest-GroupSnapshotsTest-1003911629 None] group_snapshot cdd9c788-883a-41c3-af0a-6fb4be2c9d11: deleting {{(pid=73403) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4304}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887c48fc-2832-4b60-aff9-d6d7ac53b8fd tempest-GroupSnapshotsTest-1003911629 None] deleating snapshot s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887c48fc-2832-4b60-aff9-d6d7ac53b8fd tempest-GroupSnapshotsTest-1003911629 None] get snapshots for volume s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887c48fc-2832-4b60-aff9-d6d7ac53b8fd tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887c48fc-2832-4b60-aff9-d6d7ac53b8fd tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.coordination [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Acquiring lock "cinder-d4562147-b303-4f3d-b237-e8a24dd63a70-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.coordination [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Lock "cinder-d4562147-b303-4f3d-b237-e8a24dd63a70-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=64,cinder:INSERT=3,cinder:UPDATE=33 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] remove_export for volume: d4562147-b303-4f3d-b237-e8a24dd63a70. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1453617397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d4562147-b303-4f3d-b237-e8a24dd63a70,launched_at=2023-04-14T03:16:48Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e933f7c244d4d99b3fbf950a0d73606',provider_auth='CHAP MTKuOLXB qsX9OxYI6lei3M',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4562147-b303-4f3d-b237-e8a24dd63a70 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:45Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=61a46c7e-5d8c-4650-a7d6-38bbb80200e4,status='deleting',terminated_at=2023-04-14T03:16:49Z,updated_at=2023-04-14T03:16:49Z,use_quota=True,user_id='cdac6467a80d40d58f192d0f1b6d3732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:d4562147-b303-4f3d-b237-e8a24dd63a70. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] detach volume v_d4562147-b303-4f3d-b237-e8a24dd63a70 from target iqn.2010-10.org.openstack:d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4562147-b303-4f3d-b237-e8a24dd63a70/luns/v_d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4562147-b303-4f3d-b237-e8a24dd63a70/luns/v_d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d4562147-b303-4f3d-b237-e8a24dd63a70 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4562147-b303-4f3d-b237-e8a24dd63a70/luns/v_d4562147-b303-4f3d-b237-e8a24dd63a70'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4562147-b303-4f3d-b237-e8a24dd63a70/luns/v_d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] failed to remove resource iqn.2010-10.org.openstack:d4562147-b303-4f3d-b237-e8a24dd63a70 because of JDSS resource v_d4562147-b303-4f3d-b237-e8a24dd63a70 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] delete target: iqn.2010-10.org.openstack:d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] delete target iqn.2010-10.org.openstack:d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d4562147-b303-4f3d-b237-e8a24dd63a70 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4562147-b303-4f3d-b237-e8a24dd63a70'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] failed to remove resource iqn.2010-10.org.openstack:d4562147-b303-4f3d-b237-e8a24dd63a70 because of JDSS resource iqn.2010-10.org.openstack:d4562147-b303-4f3d-b237-e8a24dd63a70 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] deleating volume v_d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] get snapshots for volume v_d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4562147-b303-4f3d-b237-e8a24dd63a70/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4562147-b303-4f3d-b237-e8a24dd63a70/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887c48fc-2832-4b60-aff9-d6d7ac53b8fd tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887c48fc-2832-4b60-aff9-d6d7ac53b8fd tempest-GroupSnapshotsTest-1003911629 None] get volume s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:16:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887c48fc-2832-4b60-aff9-d6d7ac53b8fd tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887c48fc-2832-4b60-aff9-d6d7ac53b8fd tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887c48fc-2832-4b60-aff9-d6d7ac53b8fd tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f@s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443615', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113675', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17967884095362279673', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2a68390c8f598189', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275069952', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86919', 'name': 's_b189d838-64d1-4fe7-8ef8-2601adbe8c7c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887c48fc-2832-4b60-aff9-d6d7ac53b8fd tempest-GroupSnapshotsTest-1003911629 None] delete snapshot s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c of volume v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:16:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887c48fc-2832-4b60-aff9-d6d7ac53b8fd tempest-GroupSnapshotsTest-1003911629 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f/snapshots/s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887c48fc-2832-4b60-aff9-d6d7ac53b8fd tempest-GroupSnapshotsTest-1003911629 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f/snapshots/s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4562147-b303-4f3d-b237-e8a24dd63a70/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] get volume v_d4562147-b303-4f3d-b237-e8a24dd63a70 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:16:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4@v_d4562147-b303-4f3d-b237-e8a24dd63a70', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d4562147-b303-4f3d-b237-e8a24dd63a70', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443615', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113678', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4291387024875421135', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e5f178a032bacf50', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275045376', 'san:volume_id': 'e5f178a032bacf5069e83d91f5b20766239a2c89', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86930', 'name': 'v_d4562147-b303-4f3d-b237-e8a24dd63a70', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] delete snapshot v_d4562147-b303-4f3d-b237-e8a24dd63a70 of volume v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:16:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4/snapshots/v_d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4/snapshots/v_d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:50 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:16:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Flow 'volume_create_manager' (3fd9c20c-0c61-4354-a979-99a5cbbdf570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:16:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c009ef5-8732-478e-84cc-e34b5104f04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c009ef5-8732-478e-84cc-e34b5104f04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-796863111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=972ac1b0-8c90-4a59-a53a-92321048d947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0096d0892acf4d5f8a0fa290a18b451a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=341ddf1e-6211-421f-93dd-c1b4599e2085,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:16:51Z,use_quota=True,user_id='ba8614e27c65428d92e4bf01969976e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a1fa95-b63c-44b4-bebd-69e113e0132c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a1fa95-b63c-44b4-bebd-69e113e0132c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d00da4-0b5d-4f9e-998f-f8e258855ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d00da4-0b5d-4f9e-998f-f8e258855ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '972ac1b0-8c90-4a59-a53a-92321048d947', 'volume_name': 'volume-972ac1b0-8c90-4a59-a53a-92321048d947', 'volume_size': 1, 'snapshot_id': '341ddf1e-6211-421f-93dd-c1b4599e2085'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b3cc54-66bd-4fb2-9d20-c965799e45c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b3cc54-66bd-4fb2-9d20-c965799e45c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e97ad5d-67a0-45f9-b079-9040480cd780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:50 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Volume 972ac1b0-8c90-4a59-a53a-92321048d947: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-972ac1b0-8c90-4a59-a53a-92321048d947', 'volume_size': 1, 'snapshot_id': '341ddf1e-6211-421f-93dd-c1b4599e2085'} Apr 14 03:16:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887c48fc-2832-4b60-aff9-d6d7ac53b8fd tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f/snapshots/s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887c48fc-2832-4b60-aff9-d6d7ac53b8fd tempest-GroupSnapshotsTest-1003911629 None] snapshot s_b189d838-64d1-4fe7-8ef8-2601adbe8c7c deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:16:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] create volume 972ac1b0-8c90-4a59-a53a-92321048d947 from snapshot 341ddf1e-6211-421f-93dd-c1b4599e2085 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 03:16:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] cloning s_341ddf1e-6211-421f-93dd-c1b4599e2085 to v_972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:16:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] create snapshot v_972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:16:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_341ddf1e-6211-421f-93dd-c1b4599e2085/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_341ddf1e-6211-421f-93dd-c1b4599e2085/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:50 user cinder-volume[73403]: WARNING cinder.quota [None req-887c48fc-2832-4b60-aff9-d6d7ac53b8fd tempest-GroupSnapshotsTest-1003911629 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-966777075 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-966777075, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:16:50 user cinder-volume[73403]: WARNING cinder.quota [None req-887c48fc-2832-4b60-aff9-d6d7ac53b8fd tempest-GroupSnapshotsTest-1003911629 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-966777075 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-966777075, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:16:50 user cinder-volume[73403]: DEBUG cinder.quota [None req-887c48fc-2832-4b60-aff9-d6d7ac53b8fd tempest-GroupSnapshotsTest-1003911629 None] Created reservations ['45ca5f70-9719-4a05-8b58-d61178e67c96', 'f8eeae28-ccc0-46c1-9fcf-7dd3fb19d706', '27d13634-a2b6-4ebe-811a-dd4d2d57f1dd', 'a807d4d1-656a-48db-95e6-0e86ecd43128'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:16:50 user cinder-volume[73403]: INFO cinder.volume.manager [None req-887c48fc-2832-4b60-aff9-d6d7ac53b8fd tempest-GroupSnapshotsTest-1003911629 None] group_snapshot cdd9c788-883a-41c3-af0a-6fb4be2c9d11: deleted successfully Apr 14 03:16:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4/snapshots/v_d4562147-b303-4f3d-b237-e8a24dd63a70 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] snapshot v_d4562147-b303-4f3d-b237-e8a24dd63a70 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:16:51 user cinder-volume[73403]: DEBUG cinder.quota [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Created reservations ['0c99c467-6682-40f7-81e7-1c7bd02033cb', '8aa8d08e-40ca-4b45-acd5-6fee457bb3e7', 'f04d6f6e-b320-4a7d-9941-4424aa8e3cb1', '730f3738-1862-4372-90d7-059e23ee1678'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:16:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:16:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:16:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:51 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:16:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Flow 'volume_create_manager' (1134927e-8cc5-48b0-8e59-fe7cfe28fd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:16:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105a852c-b7e0-4ee1-8960-5f1dcef0884c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105a852c-b7e0-4ee1-8960-5f1dcef0884c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=abd46acc-408d-423d-9d2a-efe1b436150a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a7784f55f824aa9ae727c1256dd8656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:16:52Z,use_quota=True,user_id='22d4913e9cb349f68d70b9f38ad29aba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0412b0a8-5fb8-4579-894a-4cfc54dd49e6),volume_type_id=0412b0a8-5fb8-4579-894a-4cfc54dd49e6)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b603c0-2a21-48ca-a023-4fb99841aa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b603c0-2a21-48ca-a023-4fb99841aa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3837be6-7404-4938-b820-bf175de3a5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3837be6-7404-4938-b820-bf175de3a5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'abd46acc-408d-423d-9d2a-efe1b436150a', 'volume_name': 'volume-abd46acc-408d-423d-9d2a-efe1b436150a', 'volume_size': 1, 'image_id': 'c95b1ea7-6ca2-431a-9f1e-53cb5268b629', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '48c58dfa5c05ccb59f51aac1ed84689c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8a7784f55f824aa9ae727c1256dd8656', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1da8a7edf8cee0a2fdfec631f6c3630e30a91083147097f0dc6e4510a179039493c81057ca49f32e9f48db2940265e7691f474ea43114b5267d51290fae8d5b8', 'id': 'c95b1ea7-6ca2-431a-9f1e-53cb5268b629', 'created_at': datetime.datetime(2023, 4, 14, 3, 16, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 3, 16, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c95b1ea7-6ca2-431a-9f1e-53cb5268b629/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58a50cc-6b3c-42bc-998e-20c21aa1ddc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58a50cc-6b3c-42bc-998e-20c21aa1ddc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e358de1a-9a41-4bb4-a5ef-4349fdc02c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:52 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Volume abd46acc-408d-423d-9d2a-efe1b436150a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-abd46acc-408d-423d-9d2a-efe1b436150a', 'volume_size': 1, 'image_id': 'c95b1ea7-6ca2-431a-9f1e-53cb5268b629', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '48c58dfa5c05ccb59f51aac1ed84689c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8a7784f55f824aa9ae727c1256dd8656', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1da8a7edf8cee0a2fdfec631f6c3630e30a91083147097f0dc6e4510a179039493c81057ca49f32e9f48db2940265e7691f474ea43114b5267d51290fae8d5b8', 'id': 'c95b1ea7-6ca2-431a-9f1e-53cb5268b629', 'created_at': datetime.datetime(2023, 4, 14, 3, 16, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 3, 16, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c95b1ea7-6ca2-431a-9f1e-53cb5268b629/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Cloning abd46acc-408d-423d-9d2a-efe1b436150a from image c95b1ea7-6ca2-431a-9f1e-53cb5268b629 at location (None, None). {{(pid=73403) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Acquiring lock "cinder-c95b1ea7-6ca2-431a-9f1e-53cb5268b629" by "_prepare_image_cache_entry" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] remove_export for volume: 32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-203377311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=baf5936f-0ae9-4a0e-b3e5-1a315f57921f,host='user@joviandss-2#joviandss-2',id=32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f,launched_at=2023-04-14T03:16:44Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0d5639765ed45e9b679f038a2775982',provider_auth='CHAP QrxVpiTt gpOwXyztTQhres',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:43Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T03:16:52Z,use_quota=True,user_id='177ee2ef30a24897a01a934cd31c755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77d6455a-ae04-4c33-904e-2db605d32f67),volume_type_id=77d6455a-ae04-4c33-904e-2db605d32f67) from target:iqn.2010-10.org.openstack:32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] detach volume v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f from target iqn.2010-10.org.openstack:32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f/luns/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f/luns/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Lock "cinder-c95b1ea7-6ca2-431a-9f1e-53cb5268b629" acquired by "_prepare_image_cache_entry" :: waited 0.054s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.coordination [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Acquiring lock "cinder-61a46c7e-5d8c-4650-a7d6-38bbb80200e4-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'available': '114275188736', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.manager [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_972ac1b0-8c90-4a59-a53a-92321048d947'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_341ddf1e-6211-421f-93dd-c1b4599e2085/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] create volume v_972ac1b0-8c90-4a59-a53a-92321048d947 from snapshot v_972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_341ddf1e-6211-421f-93dd-c1b4599e2085/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_341ddf1e-6211-421f-93dd-c1b4599e2085/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Preparing cache entry for image = c95b1ea7-6ca2-431a-9f1e-53cb5268b629 on host user@joviandss-2#joviandss-2. {{(pid=73403) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:891}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Attempting to retrieve cache entry for image = c95b1ea7-6ca2-431a-9f1e-53cb5268b629 on host user@joviandss-2#joviandss-2. {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 03:16:52 user cinder-volume[73403]: INFO cinder.volume.manager [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Deleted volume successfully. Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f/luns/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f/luns/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] failed to remove resource iqn.2010-10.org.openstack:32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f because of JDSS resource v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] delete target: iqn.2010-10.org.openstack:32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] delete target iqn.2010-10.org.openstack:32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.coordination [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Lock "cinder-61a46c7e-5d8c-4650-a7d6-38bbb80200e4-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.coordination [None req-6188d001-7419-49eb-8342-7455c64f1297 tempest-VolumesCloneTest-1216328588 None] Lock "cinder-d4562147-b303-4f3d-b237-e8a24dd63a70-delete_volume" released by "delete_volume" :: held 3.570s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] failed to remove resource iqn.2010-10.org.openstack:32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f because of JDSS resource iqn.2010-10.org.openstack:32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] deleating volume v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] get snapshots for volume v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] remove_export for volume: 61a46c7e-5d8c-4650-a7d6-38bbb80200e4. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-332024026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=61a46c7e-5d8c-4650-a7d6-38bbb80200e4,launched_at=2023-04-14T03:16:44Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e933f7c244d4d99b3fbf950a0d73606',provider_auth='CHAP oHKXSAxD GJykdqtbzKH0pN',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:61a46c7e-5d8c-4650-a7d6-38bbb80200e4 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:43Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:16:52Z,updated_at=2023-04-14T03:16:52Z,use_quota=True,user_id='cdac6467a80d40d58f192d0f1b6d3732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:61a46c7e-5d8c-4650-a7d6-38bbb80200e4. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] detach volume v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4 from target iqn.2010-10.org.openstack:61a46c7e-5d8c-4650-a7d6-38bbb80200e4 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:61a46c7e-5d8c-4650-a7d6-38bbb80200e4/luns/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:61a46c7e-5d8c-4650-a7d6-38bbb80200e4/luns/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.image.image_utils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_se7jv88iuser@joviandss-2, size 0.00 MB, duration 1.00 sec {{(pid=73403) fetch /opt/stack/cinder/cinder/image/image_utils.py:628}} Apr 14 03:16:52 user cinder-volume[73403]: INFO cinder.image.image_utils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Image download 0.00 MB at 0.00 MB/s Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:61a46c7e-5d8c-4650-a7d6-38bbb80200e4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:61a46c7e-5d8c-4650-a7d6-38bbb80200e4/luns/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:61a46c7e-5d8c-4650-a7d6-38bbb80200e4/luns/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] failed to remove resource iqn.2010-10.org.openstack:61a46c7e-5d8c-4650-a7d6-38bbb80200e4 because of JDSS resource v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] delete target: iqn.2010-10.org.openstack:61a46c7e-5d8c-4650-a7d6-38bbb80200e4 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] delete target iqn.2010-10.org.openstack:61a46c7e-5d8c-4650-a7d6-38bbb80200e4 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:61a46c7e-5d8c-4650-a7d6-38bbb80200e4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:61a46c7e-5d8c-4650-a7d6-38bbb80200e4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:61a46c7e-5d8c-4650-a7d6-38bbb80200e4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:61a46c7e-5d8c-4650-a7d6-38bbb80200e4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:61a46c7e-5d8c-4650-a7d6-38bbb80200e4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] failed to remove resource iqn.2010-10.org.openstack:61a46c7e-5d8c-4650-a7d6-38bbb80200e4 because of JDSS resource iqn.2010-10.org.openstack:61a46c7e-5d8c-4650-a7d6-38bbb80200e4 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] deleating volume v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] get snapshots for volume v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_se7jv88iuser@joviandss-2 {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:16:52 user sudo[95919]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_se7jv88iuser@joviandss-2 Apr 14 03:16:52 user sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] get volume v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443612', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113663', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1935072961883809390', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f09fe954529ca4c7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275164160', 'san:volume_id': 'f09fe954529ca4c76730810733d763343d2f2381', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86423', 'name': 'v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] delete volume:v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] get volume v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:16:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443612', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113666', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17608046888938029271', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4eeef6a6d114e2e1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275164160', 'san:volume_id': '4eeef6a6d114e2e15ead1587ebb1771d25240175', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86431', 'name': 'v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] delete volume:v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:16:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_341ddf1e-6211-421f-93dd-c1b4599e2085@v_972ac1b0-8c90-4a59-a53a-92321048d947', 'is_clone': True, 'full_name': 'Pool-0/v_972ac1b0-8c90-4a59-a53a-92321048d947', 'name': 'v_972ac1b0-8c90-4a59-a53a-92321048d947'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_341ddf1e-6211-421f-93dd-c1b4599e2085/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] get volume v_972ac1b0-8c90-4a59-a53a-92321048d947 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:16:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_341ddf1e-6211-421f-93dd-c1b4599e2085@v_972ac1b0-8c90-4a59-a53a-92321048d947', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_972ac1b0-8c90-4a59-a53a-92321048d947', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443621', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '266240', 'sharesmb': None, 'createtxg': '113693', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10461941340769055764', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c7de50823280b058', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275164160', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '7.80', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86448', 'name': 'v_972ac1b0-8c90-4a59-a53a-92321048d947', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:53 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=70,cinder:UPDATE=24,cinder:DELETE=3,cinder:INSERT=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e97ad5d-67a0-45f9-b079-9040480cd780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-972ac1b0-8c90-4a59-a53a-92321048d947', 'volume_size': 1, 'snapshot_id': '341ddf1e-6211-421f-93dd-c1b4599e2085'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0210491-2f0d-4e6b-ae05-4d3546eda301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:16:53 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Volume volume-972ac1b0-8c90-4a59-a53a-92321048d947 (972ac1b0-8c90-4a59-a53a-92321048d947): created successfully Apr 14 03:16:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0210491-2f0d-4e6b-ae05-4d3546eda301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:16:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Flow 'volume_create_manager' (3fd9c20c-0c61-4354-a979-99a5cbbdf570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:16:53 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8260cbb2-964a-426d-8dc2-a5700fd88c8d tempest-SnapshotDataIntegrityTests-450991924 None] Created volume successfully. Apr 14 03:16:53 user sudo[95919]: pam_unix(sudo:session): session closed for user root Apr 14 03:16:53 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_se7jv88iuser@joviandss-2" returned: 0 in 1.022s {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:16:53 user cinder-volume[73403]: DEBUG cinder.image.image_utils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Temporary image c95b1ea7-6ca2-431a-9f1e-53cb5268b629 is fetched for user 22d4913e9cb349f68d70b9f38ad29aba. {{(pid=73403) fetch /opt/stack/cinder/cinder/image/image_utils.py:1279}} Apr 14 03:16:53 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_se7jv88iuser@joviandss-2 {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:16:53 user sudo[95924]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_se7jv88iuser@joviandss-2 Apr 14 03:16:53 user sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 03:16:54 user sudo[95924]: pam_unix(sudo:session): session closed for user root Apr 14 03:16:54 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_se7jv88iuser@joviandss-2" returned: 0 in 0.796s {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:16:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] creating volume v_abd46acc-408d-423d-9d2a-efe1b436150a. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:16:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] create volume {'name': 'v_abd46acc-408d-423d-9d2a-efe1b436150a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:16:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] volume v_32e5c1b1-fc76-4c6a-83b2-9d29a48bb41f deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:16:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] create export for volume: 972ac1b0-8c90-4a59-a53a-92321048d947. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:16:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] ensure volume 972ac1b0-8c90-4a59-a53a-92321048d947 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:16:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] check if targe iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:16:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:54 user cinder-volume[73403]: DEBUG cinder.quota [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Created reservations ['d806cacf-f688-4d44-a288-1a42fbf4a54e'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:16:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] create target and attach volume 972ac1b0-8c90-4a59-a53a-92321048d947 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:16:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] create target iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:16:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:54 user cinder-volume[73403]: WARNING cinder.quota [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-966777075 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-966777075, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:16:54 user cinder-volume[73403]: DEBUG cinder.quota [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Created reservations ['31a97671-a735-4e64-bc40-4ea1074e4db7', 'b55f5ade-186a-4bd4-b784-f96522f47df2', '67deb45c-d84d-4b5c-b3bd-c9da8be19558', 'c36da143-ea6a-483a-a6c1-4d9f9a29e8c6'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] volume v_61a46c7e-5d8c-4650-a7d6-38bbb80200e4 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=64,cinder:UPDATE=26,cinder:INSERT=9,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.quota [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Created reservations ['ed984500-e8d6-430a-ad41-02971377b8fe', '7879163c-a0b7-4c0e-8b97-f207555ec4df', '94735a4d-6eb1-40db-ae14-348ee56f7a7e', 'a5540145-4fbd-4e1a-b454-b5fe3e5fb146'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Geting {'code': 200, 'error': None, 'data': {'available': '114275188736', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.manager [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:16:55 user cinder-volume[73403]: INFO cinder.volume.manager [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Deleted volume successfully. Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.coordination [None req-97e88dd0-7408-4602-8b57-b9b4f1928b8c tempest-VolumesCloneTest-1216328588 None] Lock "cinder-61a46c7e-5d8c-4650-a7d6-38bbb80200e4-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_abd46acc-408d-423d-9d2a-efe1b436150a', 'is_clone': False, 'name': 'v_abd46acc-408d-423d-9d2a-efe1b436150a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Attempting download of c95b1ea7-6ca2-431a-9f1e-53cb5268b629 ((None, None)) to volume abd46acc-408d-423d-9d2a-efe1b436150a. {{(pid=73403) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.driver [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] copy_image_to_volume volume-abd46acc-408d-423d-9d2a-efe1b436150a. {{(pid=73403) _copy_image_data_to_volume /opt/stack/cinder/cinder/volume/driver.py:890}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG os_brick.utils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=73403) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[73aec0f7-749d-4e74-9f44-84d0085e440e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e1198c5ebb57\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[64353052-493a-4978-b4f8-5ad8ddeef7b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd76dcef-556a-4aa9-bf52-1ff92ee2710a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c1407e-7f1e-4a35-a522-f847cdf47ecf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Running cmd (subprocess): nvme version {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] 'nvme version' failed. Not Retrying. {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] nvme not present on system {{(pid=73403) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 03:16:55 user cinder-volume[73403]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Apr 14 03:16:55 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5ef90a-9cda-4df1-9acd-c6ee7268ab83]: (4, '') {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.lightos [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73403) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.lightos [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73403) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.lightos [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] LIGHTOS: no hostnqn found. {{(pid=73403) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG os_brick.utils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e1198c5ebb57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73403) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.driver [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Volume abd46acc-408d-423d-9d2a-efe1b436150a: creating export {{(pid=73403) _attach_volume /opt/stack/cinder/cinder/volume/driver.py:1051}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] create export for volume: abd46acc-408d-423d-9d2a-efe1b436150a. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] ensure volume abd46acc-408d-423d-9d2a-efe1b436150a assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] check if targe iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] create target and attach volume abd46acc-408d-423d-9d2a-efe1b436150a to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] create target iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Geting {'code': 200, 'error': None, 'data': {'available': '114275221504', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:16:55 user cinder-volume[73403]: DEBUG cinder.manager [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:16:55 user cinder-volume[73403]: INFO cinder.volume.manager [None req-4c11d3b3-6b33-4667-b4fd-903fcd14b9fd tempest-GroupSnapshotsTest-1003911629 None] Delete group completed successfully. Apr 14 03:16:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] atach volume v_972ac1b0-8c90-4a59-a53a-92321048d947 to target iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:16:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] atach volume v_abd46acc-408d-423d-9d2a-efe1b436150a to target iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:16:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6337646535303832', 'lun': 0, 'mode': 'wt', 'name': 'v_972ac1b0-8c90-4a59-a53a-92321048d947', 'prod_id': 'Storage', 'scsi_id': 'c7de50823280b058'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] add credentails to target iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:16:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:16:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 201, 'error': None, 'data': {'name': 'BqELIMHk'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] initialize_connection for 972ac1b0-8c90-4a59-a53a-92321048d947 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:16:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqELIMHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '06f40f10-3df7-4048-9faf-8ffd652cf3a9'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:16:59 user cinder-volume[73403]: INFO cinder.volume.manager [req-14a668f1-51a5-4155-9442-ca06617a474c req-fc9b0786-65b2-48e8-8aed-e6df70e317f1 tempest-SnapshotDataIntegrityTests-450991924 None] attachment_update completed successfully. Apr 14 03:16:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3966383161343033', 'lun': 0, 'mode': 'wt', 'name': 'v_abd46acc-408d-423d-9d2a-efe1b436150a', 'prod_id': 'Storage', 'scsi_id': '9f81a403c72ff3e2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:16:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] add credentails to target iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:16:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:16:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Geting {'code': 201, 'error': None, 'data': {'name': 'nCdIFtaN'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] initialize_connection for abd46acc-408d-423d-9d2a-efe1b436150a 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connector [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Factory for iscsi on None {{(pid=73403) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nCdIFtaN', 'auth_password': '***', 'target_lun': False}}" {{(pid=73403) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 03:17:00 user cinder-volume[73403]: INFO os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Trying to connect to iSCSI portal 172.16.0.220:3260 Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc14550f-b662-4039-b21a-84daa4df8a50]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Apr 14 03:17:00 user cinder-volume[73403]: {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 --interface default --op new {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[158280b7-4858-4669-bab4-5325d274a76e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a] added\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a] added Apr 14 03:17:00 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[891bf5b2-67aa-4808-bd45-9f67fe27c606]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7203c92-fc70-4c64-95ae-c3b39d860cb0]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nCdIFtaN {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nCdIFtaN" returned: 0 in 0.020s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dc2762-30d5-4691-8aa0-3a9a86706856]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nCdIFtaN'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1136e16-6e03-44e0-a286-5fc25c2cfb72]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf12adb-6bac-4d50-af88-7b677e7ffd4e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b (non-flash)\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c (non-flash) Apr 14 03:17:00 user cinder-volume[73403]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab (non-flash) Apr 14 03:17:00 user cinder-volume[73403]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b (non-flash) Apr 14 03:17:00 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c (non-flash) Apr 14 03:17:00 user cinder-volume[73403]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab (non-flash) Apr 14 03:17:00 user cinder-volume[73403]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b (non-flash) Apr 14 03:17:00 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 --login {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e99d22-4fc6-4bcd-9aaa-2403be4dcdb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a, portal: 172.16.0.220,3260] Apr 14 03:17:00 user cinder-volume[73403]: Login to [iface: default, target: iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a, portal: 172.16.0.220,3260] successful. Apr 14 03:17:00 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[326f229b-3eb0-4452-b2f6-829b9536b527]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c63b75-8cef-4a0f-ac48-5b096c7c74a6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a (non-flash)\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c (non-flash) Apr 14 03:17:00 user cinder-volume[73403]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab (non-flash) Apr 14 03:17:00 user cinder-volume[73403]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b (non-flash) Apr 14 03:17:00 user cinder-volume[73403]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a (non-flash) Apr 14 03:17:00 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c (non-flash) Apr 14 03:17:00 user cinder-volume[73403]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab (non-flash) Apr 14 03:17:00 user cinder-volume[73403]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b (non-flash) Apr 14 03:17:00 user cinder-volume[73403]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a (non-flash) Apr 14 03:17:00 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Connected to 172.16.0.220:3260 {{(pid=73403) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=73403) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Scanning host 35 c: -, t: -, l: 0) {{(pid=73403) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcbb5b4-8610-4562-8d54-518c7a8392be]: (4, ('- - 0', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73403) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}} Apr 14 03:17:00 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nCdIFtaN', 'auth_password': '***', 'target_lun': False} {{(pid=73403) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}} Apr 14 03:17:01 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 03:17:01 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23966383161343033', 'path': '/dev/sdd'} {{(pid=73403) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 03:17:01 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): dd if=/dev/sdd of=/dev/null count=1 {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:01 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "dd if=/dev/sdd of=/dev/null count=1" returned: 0 in 0.090s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:01 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[42927914-d3d6-4e84-8bcf-a90712e24d40]: (4, ('', '1+0 records in\n1+0 records out\n512 bytes copied, 0.0272635 s, 18.8 kB/s\n')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:01 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_0fxh78e3 {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:01 user sudo[96039]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_0fxh78e3 Apr 14 03:17:01 user sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 03:17:02 user sudo[96039]: pam_unix(sudo:session): session closed for user root Apr 14 03:17:02 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_0fxh78e3" returned: 0 in 0.817s {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:02 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_se7jv88iuser@joviandss-2 {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:02 user sudo[96056]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_se7jv88iuser@joviandss-2 Apr 14 03:17:02 user sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 03:17:03 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:17:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Flow 'volume_create_manager' (2d7311aa-b09c-4aa6-9fbe-4d21688a1a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:17:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee25f934-c836-42a8-9165-3612c48ec1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee25f934-c836-42a8-9165-3612c48ec1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-510282876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=34a64935-b23d-447b-a051-af21bae72340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7621ab4a450426e90b38eafb6ed5dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:17:03Z,use_quota=True,user_id='e6fb05d7d8fa49c1a3238d33928df7d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0988fda4-7c37-4ede-8152-5d11303df2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0988fda4-7c37-4ede-8152-5d11303df2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d920018b-244a-42e9-9387-9ff44f484d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d920018b-244a-42e9-9387-9ff44f484d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34a64935-b23d-447b-a051-af21bae72340', 'volume_name': 'volume-34a64935-b23d-447b-a051-af21bae72340', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a65133d-7cd3-4f8d-bc8c-d8ae2e219659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a65133d-7cd3-4f8d-bc8c-d8ae2e219659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47bedfd-84c7-47a6-8a35-f7393c3bd599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:03 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Volume 34a64935-b23d-447b-a051-af21bae72340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34a64935-b23d-447b-a051-af21bae72340', 'volume_size': 1} Apr 14 03:17:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] creating volume v_34a64935-b23d-447b-a051-af21bae72340. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:17:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] create volume {'name': 'v_34a64935-b23d-447b-a051-af21bae72340', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:17:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:03 user sudo[96056]: pam_unix(sudo:session): session closed for user root Apr 14 03:17:03 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_se7jv88iuser@joviandss-2" returned: 0 in 0.834s {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:03 user cinder-volume[73403]: DEBUG cinder.image.image_utils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] c95b1ea7-6ca2-431a-9f1e-53cb5268b629 was raw, converting to raw {{(pid=73403) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:976}} Apr 14 03:17:03 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_se7jv88iuser@joviandss-2 of=/dev/sdd oflag=direct {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:03 user sudo[96066]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_se7jv88iuser@joviandss-2 of=/dev/sdd oflag=direct Apr 14 03:17:03 user sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 03:17:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:17:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:17:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:17:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:04 user sudo[96066]: pam_unix(sudo:session): session closed for user root Apr 14 03:17:04 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_se7jv88iuser@joviandss-2 of=/dev/sdd oflag=direct" returned: 0 in 0.698s {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:04 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f raw /opt/stack/data/cinder/conversion/image_fetch_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_se7jv88iuser@joviandss-2 /dev/sdd {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:04 user sudo[96071]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f raw /opt/stack/data/cinder/conversion/image_fetch_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_se7jv88iuser@joviandss-2 /dev/sdd Apr 14 03:17:04 user sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 03:17:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114275094528', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:17:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:17:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_34a64935-b23d-447b-a051-af21bae72340', 'is_clone': False, 'name': 'v_34a64935-b23d-447b-a051-af21bae72340'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47bedfd-84c7-47a6-8a35-f7393c3bd599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a64935-b23d-447b-a051-af21bae72340', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6baf099c-15a3-49f9-8e94-b13c6bbce422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:04 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Volume volume-34a64935-b23d-447b-a051-af21bae72340 (34a64935-b23d-447b-a051-af21bae72340): created successfully Apr 14 03:17:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6baf099c-15a3-49f9-8e94-b13c6bbce422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Flow 'volume_create_manager' (2d7311aa-b09c-4aa6-9fbe-4d21688a1a0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:17:04 user cinder-volume[73403]: INFO cinder.volume.manager [None req-0cbb16f6-de07-4640-a98b-fe48ac4510eb tempest-VolumesServicesTestJSON-2038655423 None] Created volume successfully. Apr 14 03:17:04 user sudo[96071]: pam_unix(sudo:session): session closed for user root Apr 14 03:17:04 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f raw /opt/stack/data/cinder/conversion/image_fetch_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_se7jv88iuser@joviandss-2 /dev/sdd" returned: 0 in 0.929s {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:04 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_se7jv88iuser@joviandss-2 {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:05 user sudo[96114]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_se7jv88iuser@joviandss-2 Apr 14 03:17:05 user sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Acquiring lock "cinder-34a64935-b23d-447b-a051-af21bae72340-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Lock "cinder-34a64935-b23d-447b-a051-af21bae72340-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] remove_export for volume: 34a64935-b23d-447b-a051-af21bae72340. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-510282876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=34a64935-b23d-447b-a051-af21bae72340,launched_at=2023-04-14T03:17:05Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7621ab4a450426e90b38eafb6ed5dd8',provider_auth='CHAP cmzHeIgx YvZQIA4L2W1DTa',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a64935-b23d-447b-a051-af21bae72340 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:17:03Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:17:05Z,updated_at=2023-04-14T03:17:05Z,use_quota=True,user_id='e6fb05d7d8fa49c1a3238d33928df7d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:34a64935-b23d-447b-a051-af21bae72340. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] detach volume v_34a64935-b23d-447b-a051-af21bae72340 from target iqn.2010-10.org.openstack:34a64935-b23d-447b-a051-af21bae72340 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34a64935-b23d-447b-a051-af21bae72340/luns/v_34a64935-b23d-447b-a051-af21bae72340 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34a64935-b23d-447b-a051-af21bae72340/luns/v_34a64935-b23d-447b-a051-af21bae72340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:34a64935-b23d-447b-a051-af21bae72340 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34a64935-b23d-447b-a051-af21bae72340/luns/v_34a64935-b23d-447b-a051-af21bae72340'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34a64935-b23d-447b-a051-af21bae72340/luns/v_34a64935-b23d-447b-a051-af21bae72340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] failed to remove resource iqn.2010-10.org.openstack:34a64935-b23d-447b-a051-af21bae72340 because of JDSS resource v_34a64935-b23d-447b-a051-af21bae72340 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] delete target: iqn.2010-10.org.openstack:34a64935-b23d-447b-a051-af21bae72340 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] delete target iqn.2010-10.org.openstack:34a64935-b23d-447b-a051-af21bae72340 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34a64935-b23d-447b-a051-af21bae72340 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34a64935-b23d-447b-a051-af21bae72340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:34a64935-b23d-447b-a051-af21bae72340 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34a64935-b23d-447b-a051-af21bae72340'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:34a64935-b23d-447b-a051-af21bae72340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] failed to remove resource iqn.2010-10.org.openstack:34a64935-b23d-447b-a051-af21bae72340 because of JDSS resource iqn.2010-10.org.openstack:34a64935-b23d-447b-a051-af21bae72340 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] deleating volume v_34a64935-b23d-447b-a051-af21bae72340 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] get snapshots for volume v_34a64935-b23d-447b-a051-af21bae72340 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34a64935-b23d-447b-a051-af21bae72340/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34a64935-b23d-447b-a051-af21bae72340/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-442e2f08-8fb3-46db-9b74-7587defb548b req-2924805c-38c4-4ebd-9826-fde4292b5a02 tempest-SnapshotDataIntegrityTests-450991924 None] terminate connection for 972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:17:05 user cinder-volume[73403]: INFO cinder.volume.manager [req-442e2f08-8fb3-46db-9b74-7587defb548b req-2924805c-38c4-4ebd-9826-fde4292b5a02 tempest-SnapshotDataIntegrityTests-450991924 None] Terminate volume connection completed successfully. Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-442e2f08-8fb3-46db-9b74-7587defb548b req-2924805c-38c4-4ebd-9826-fde4292b5a02 tempest-SnapshotDataIntegrityTests-450991924 None] Deleting attachment 06f40f10-3df7-4048-9faf-8ffd652cf3a9. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-442e2f08-8fb3-46db-9b74-7587defb548b req-2924805c-38c4-4ebd-9826-fde4292b5a02 tempest-SnapshotDataIntegrityTests-450991924 None] remove_export for volume: 972ac1b0-8c90-4a59-a53a-92321048d947. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-442e2f08-8fb3-46db-9b74-7587defb548b req-2924805c-38c4-4ebd-9826-fde4292b5a02 tempest-SnapshotDataIntegrityTests-450991924 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-442e2f08-8fb3-46db-9b74-7587defb548b req-2924805c-38c4-4ebd-9826-fde4292b5a02 tempest-SnapshotDataIntegrityTests-450991924 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-796863111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=972ac1b0-8c90-4a59-a53a-92321048d947,launched_at=2023-04-14T03:16:53Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0096d0892acf4d5f8a0fa290a18b451a',provider_auth='CHAP BqELIMHk 3b5wTlGSiezVs2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:51Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=341ddf1e-6211-421f-93dd-c1b4599e2085,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:17:05Z,use_quota=True,user_id='ba8614e27c65428d92e4bf01969976e7',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-442e2f08-8fb3-46db-9b74-7587defb548b req-2924805c-38c4-4ebd-9826-fde4292b5a02 tempest-SnapshotDataIntegrityTests-450991924 None] detach volume v_972ac1b0-8c90-4a59-a53a-92321048d947 from target iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-442e2f08-8fb3-46db-9b74-7587defb548b req-2924805c-38c4-4ebd-9826-fde4292b5a02 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947/luns/v_972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-442e2f08-8fb3-46db-9b74-7587defb548b req-2924805c-38c4-4ebd-9826-fde4292b5a02 tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947/luns/v_972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:05 user sudo[96114]: pam_unix(sudo:session): session closed for user root Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_se7jv88iuser@joviandss-2" returned: 0 in 0.825s {{(pid=73403) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG cinder.image.image_utils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c95b1ea7-6ca2-431a-9f1e-53cb5268b629_se7jv88iuser@joviandss-2, size 0.00 MB, duration 1.00 sec, destination /dev/sdd {{(pid=73403) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:432}} Apr 14 03:17:05 user cinder-volume[73403]: INFO cinder.image.image_utils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Converted 0.00 MB image at 0.00 MB/s Apr 14 03:17:05 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nCdIFtaN', 'auth_password': '***', 'target_lun': 0, 'encrypted': False}, {'type': 'block', 'scsi_wwn': '23966383161343033', 'path': '/dev/sdd'}), 'kwargs': {'force': False}}" {{(pid=73403) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[943102e3-e7fd-42d0-a452-95a944a065a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Apr 14 03:17:05 user cinder-volume[73403]: No targets found. Apr 14 03:17:05 user cinder-volume[73403]: iSNS: Apr 14 03:17:05 user cinder-volume[73403]: No targets found. Apr 14 03:17:05 user cinder-volume[73403]: STATIC: Apr 14 03:17:05 user cinder-volume[73403]: Target: iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a Apr 14 03:17:05 user cinder-volume[73403]: Portal: 172.16.0.220:3260,-1 Apr 14 03:17:05 user cinder-volume[73403]: Iface Name: default Apr 14 03:17:05 user cinder-volume[73403]: Target: iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b Apr 14 03:17:05 user cinder-volume[73403]: Portal: 172.16.0.220:3260,-1 Apr 14 03:17:05 user cinder-volume[73403]: Iface Name: default Apr 14 03:17:05 user cinder-volume[73403]: Target: iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c Apr 14 03:17:05 user cinder-volume[73403]: Portal: 172.16.0.220:3260,-1 Apr 14 03:17:05 user cinder-volume[73403]: Iface Name: default Apr 14 03:17:05 user cinder-volume[73403]: Target: iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab Apr 14 03:17:05 user cinder-volume[73403]: Portal: 172.16.0.220:3260,-1 Apr 14 03:17:05 user cinder-volume[73403]: Iface Name: default Apr 14 03:17:05 user cinder-volume[73403]: FIRMWARE: Apr 14 03:17:05 user cinder-volume[73403]: No targets found. Apr 14 03:17:05 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Regex to get portals from discoverydb: ^SENDTARGETS: Apr 14 03:17:05 user cinder-volume[73403]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Apr 14 03:17:05 user cinder-volume[73403]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=73403) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a', 0)] {{(pid=73403) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1210196-c186-4965-956e-bdfc21415f46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3d8000-cc9e-4415-a007-63e3c60eac37]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a (non-flash)\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c (non-flash) Apr 14 03:17:05 user cinder-volume[73403]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab (non-flash) Apr 14 03:17:05 user cinder-volume[73403]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b (non-flash) Apr 14 03:17:05 user cinder-volume[73403]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a (non-flash) Apr 14 03:17:05 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c (non-flash) Apr 14 03:17:05 user cinder-volume[73403]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab (non-flash) Apr 14 03:17:05 user cinder-volume[73403]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b (non-flash) Apr 14 03:17:05 user cinder-volume[73403]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a (non-flash) Apr 14 03:17:05 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Resulting device map defaultdict(. at 0x7f81eebc6a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a'): ({'sdd'}, set())}) {{(pid=73403) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Removing single pathed devices sdd {{(pid=73403) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[b407a71b-3154-4a87-a2db-e9ccb53408a2]: (4, ('path checker states:\nup 4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4393a1-e88f-47bf-b8f7-816f20c888b9]: (4, ('ok\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Flushing IO for device /dev/sdd {{(pid=73403) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ff3a9c-e9a1-4708-90af-653ea1558135]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73403) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.068s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[967ace9c-eb4f-489b-b242-5e6f0a51e88b]: (4, ('1', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=73403) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG os_brick.initiator.linuxscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] SCSI volumes sdd have been removed. {{(pid=73403) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a')] {{(pid=73403) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}} Apr 14 03:17:05 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-442e2f08-8fb3-46db-9b74-7587defb548b req-2924805c-38c4-4ebd-9826-fde4292b5a02 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947/luns/v_972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-442e2f08-8fb3-46db-9b74-7587defb548b req-2924805c-38c4-4ebd-9826-fde4292b5a02 tempest-SnapshotDataIntegrityTests-450991924 None] delete target: iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-442e2f08-8fb3-46db-9b74-7587defb548b req-2924805c-38c4-4ebd-9826-fde4292b5a02 tempest-SnapshotDataIntegrityTests-450991924 None] delete target iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-442e2f08-8fb3-46db-9b74-7587defb548b req-2924805c-38c4-4ebd-9826-fde4292b5a02 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-442e2f08-8fb3-46db-9b74-7587defb548b req-2924805c-38c4-4ebd-9826-fde4292b5a02 tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1aa1d17-3d0c-475f-b436-d8443a50e4ec]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 --logout {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34a64935-b23d-447b-a051-af21bae72340/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] get volume v_34a64935-b23d-447b-a051-af21bae72340 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34a64935-b23d-447b-a051-af21bae72340 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34a64935-b23d-447b-a051-af21bae72340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[0434174b-d189-4f1a-bf81-7bc52dc16910]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a, portal: 172.16.0.220,3260] Apr 14 03:17:06 user cinder-volume[73403]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a, portal: 172.16.0.220,3260] successful. Apr 14 03:17:06 user cinder-volume[73403]: stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_34a64935-b23d-447b-a051-af21bae72340', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443633', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113712', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10301451820875180498', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e320c374bcce0cf0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114264866816', 'san:volume_id': 'e320c374bcce0cf0f84ebf8aa105cbed977ca7f2', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86719', 'name': 'v_34a64935-b23d-447b-a051-af21bae72340', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34a64935-b23d-447b-a051-af21bae72340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] delete volume:v_34a64935-b23d-447b-a051-af21bae72340 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34a64935-b23d-447b-a051-af21bae72340 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34a64935-b23d-447b-a051-af21bae72340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 --op delete {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81139) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd50f6bd-12e6-491c-92fb-de70572d81ef]: (4, ('', '')) {{(pid=81139) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73403) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.base [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=73403) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] <== disconnect_volume: return (338ms) None {{(pid=73403) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] terminate connection for abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.driver [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] volume abd46acc-408d-423d-9d2a-efe1b436150a: removing export {{(pid=73403) _detach_volume /opt/stack/cinder/cinder/volume/driver.py:560}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] remove_export for volume: abd46acc-408d-423d-9d2a-efe1b436150a. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=abd46acc-408d-423d-9d2a-efe1b436150a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a7784f55f824aa9ae727c1256dd8656',provider_auth='CHAP nCdIFtaN k249qV0ZpudiDS',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='downloading',terminated_at=None,updated_at=2023-04-14T03:16:52Z,use_quota=True,user_id='22d4913e9cb349f68d70b9f38ad29aba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0412b0a8-5fb8-4579-894a-4cfc54dd49e6),volume_type_id=0412b0a8-5fb8-4579-894a-4cfc54dd49e6) from target:iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] detach volume v_abd46acc-408d-423d-9d2a-efe1b436150a from target iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a/luns/v_abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a/luns/v_abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-442e2f08-8fb3-46db-9b74-7587defb548b req-2924805c-38c4-4ebd-9826-fde4292b5a02 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-442e2f08-8fb3-46db-9b74-7587defb548b req-2924805c-38c4-4ebd-9826-fde4292b5a02 tempest-SnapshotDataIntegrityTests-450991924 None] target iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a/luns/v_abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] delete target: iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] delete target iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] target iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Downloaded image c95b1ea7-6ca2-431a-9f1e-53cb5268b629 ((None, None)) to volume abd46acc-408d-423d-9d2a-efe1b436150a successfully. {{(pid=73403) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1232}} Apr 14 03:17:06 user cinder-volume[73403]: DEBUG cinder.image.image_utils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Temporary image c95b1ea7-6ca2-431a-9f1e-53cb5268b629 for user 22d4913e9cb349f68d70b9f38ad29aba is deleted. {{(pid=73403) fetch /opt/stack/cinder/cinder/image/image_utils.py:1283}} Apr 14 03:17:07 user cinder-volume[73403]: WARNING cinder.quota [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:17:07 user cinder-volume[73403]: WARNING cinder.quota [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:17:07 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=53,cinder:DELETE=2,cinder:INSERT=9,cinder:UPDATE=36 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.quota [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Created reservations ['c25fa8f7-2bc4-43ff-a349-9a754c1b63d3', '142a177c-8139-4ab3-8f36-22ae0f61512a', '583f30a0-52f5-4b48-a4ad-461976824e3b', '37d52398-884b-4563-b85a-78d84e2bc455'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Creating image volume entry: {'cluster_name': None, 'scheduled_at': datetime.datetime(2023, 4, 14, 3, 16, 52, tzinfo=datetime.timezone.utc), 'launched_at': None, 'display_description': None, 'created_at': datetime.datetime(2023, 4, 14, 3, 16, 52, tzinfo=datetime.timezone.utc), 'replication_extended_status': None, 'service_uuid': None, 'availability_zone': 'nova', 'user_id': '22d4913e9cb349f68d70b9f38ad29aba', 'multiattach': False, 'ec2_id': None, 'volume_type_id': '0412b0a8-5fb8-4579-894a-4cfc54dd49e6', 'deleted': False, 'replication_status': None, 'size': 1, 'volume_metadata': [], 'provider_auth': 'CHAP nCdIFtaN k249qV0ZpudiDS', 'updated_at': datetime.datetime(2023, 4, 14, 3, 16, 52, tzinfo=datetime.timezone.utc), 'shared_targets': True, 'display_name': 'image-c95b1ea7-6ca2-431a-9f1e-53cb5268b629', 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'consistencygroup_id': None, 'replication_driver_data': None, 'encryption_key_id': None, 'provider_id': None, 'host': 'user@joviandss-2#joviandss-2', 'volume_admin_metadata': [], 'project_id': '26e1e7b31d8647499d4f6edae9f171df', 'terminated_at': None, 'group_id': None, 'metadata': {}, 'provider_location': '172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a 0', 'bootable': False, 'deleted_at': None, 'provider_geometry': None, 'previous_status': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': 'abd46acc-408d-423d-9d2a-efe1b436150a'}. {{(pid=73403) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1660}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Volume reschedule parameters: False retry: None {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Flow 'volume_create_manager' (365b22b1-3489-4485-9c16-be4c07c5c51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ad3a8c-d053-4d3e-9376-c6d667c335ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ad3a8c-d053-4d3e-9376-c6d667c335ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='image-c95b1ea7-6ca2-431a-9f1e-53cb5268b629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2784c1d4-07f9-458e-b169-76f4e5f48cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e1e7b31d8647499d4f6edae9f171df',provider_auth='CHAP nCdIFtaN k249qV0ZpudiDS',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=abd46acc-408d-423d-9d2a-efe1b436150a,status='creating',terminated_at=None,updated_at=2023-04-14T03:16:52Z,use_quota=True,user_id='22d4913e9cb349f68d70b9f38ad29aba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0412b0a8-5fb8-4579-894a-4cfc54dd49e6),volume_type_id=0412b0a8-5fb8-4579-894a-4cfc54dd49e6)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec477e4-61e3-40b3-8f40-0ea3eaa86698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec477e4-61e3-40b3-8f40-0ea3eaa86698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a322b2a-f153-4321-9c16-518261c39a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a322b2a-f153-4321-9c16-518261c39a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2784c1d4-07f9-458e-b169-76f4e5f48cec', 'volume_name': 'volume-2784c1d4-07f9-458e-b169-76f4e5f48cec', 'volume_size': 1, 'source_volid': 'abd46acc-408d-423d-9d2a-efe1b436150a', 'source_volstatus': 'downloading'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca407976-4da6-4431-a8e2-17cb86e70f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca407976-4da6-4431-a8e2-17cb86e70f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4babf98-583c-468f-8fb4-29a24222b554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:07 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Volume 2784c1d4-07f9-458e-b169-76f4e5f48cec: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2784c1d4-07f9-458e-b169-76f4e5f48cec', 'volume_size': 1, 'source_volid': 'abd46acc-408d-423d-9d2a-efe1b436150a', 'source_volstatus': 'downloading'} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] cloned volume abd46acc-408d-423d-9d2a-efe1b436150a to 2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] cloning v_abd46acc-408d-423d-9d2a-efe1b436150a to v_2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] create snapshot v_2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_abd46acc-408d-423d-9d2a-efe1b436150a/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_abd46acc-408d-423d-9d2a-efe1b436150a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_34a64935-b23d-447b-a051-af21bae72340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] volume v_34a64935-b23d-447b-a051-af21bae72340 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.quota [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Created reservations ['215326fb-c493-40fd-b558-f5ed651bddd9', '806134e8-ae11-4745-9334-bf1567ba7cad', '295b75b9-6daa-4e9d-83a7-2422e4acf590', 'd34f39ec-a9c1-4391-87cb-058e140c4be2'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_2784c1d4-07f9-458e-b169-76f4e5f48cec'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_abd46acc-408d-423d-9d2a-efe1b436150a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] create volume v_2784c1d4-07f9-458e-b169-76f4e5f48cec from snapshot v_2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:17:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_abd46acc-408d-423d-9d2a-efe1b436150a/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_abd46acc-408d-423d-9d2a-efe1b436150a/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Geting {'code': 200, 'error': None, 'data': {'available': '114264907776', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:17:08 user cinder-volume[73403]: DEBUG cinder.manager [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:17:08 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Deleted volume successfully. Apr 14 03:17:08 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a1cd3ee3-0017-499f-a550-d51039653fc5 tempest-VolumesServicesTestJSON-2038655423 None] Lock "cinder-34a64935-b23d-447b-a051-af21bae72340-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:17:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_abd46acc-408d-423d-9d2a-efe1b436150a@v_2784c1d4-07f9-458e-b169-76f4e5f48cec', 'is_clone': True, 'full_name': 'Pool-0/v_2784c1d4-07f9-458e-b169-76f4e5f48cec', 'name': 'v_2784c1d4-07f9-458e-b169-76f4e5f48cec'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_abd46acc-408d-423d-9d2a-efe1b436150a/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] get volume v_2784c1d4-07f9-458e-b169-76f4e5f48cec info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:17:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_abd46acc-408d-423d-9d2a-efe1b436150a@v_2784c1d4-07f9-458e-b169-76f4e5f48cec', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2784c1d4-07f9-458e-b169-76f4e5f48cec', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443637', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '61440', 'sharesmb': None, 'createtxg': '113729', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2545877304588140334', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'dce70a46d21dc71b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114264875008', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.87', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '86085', 'name': 'v_2784c1d4-07f9-458e-b169-76f4e5f48cec', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '159744', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4babf98-583c-468f-8fb4-29a24222b554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2784c1d4-07f9-458e-b169-76f4e5f48cec', 'volume_size': 1, 'source_volid': 'abd46acc-408d-423d-9d2a-efe1b436150a', 'source_volstatus': 'downloading'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c158d2aa-8a9c-4939-9fa3-a34a986121a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:09 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Volume volume-2784c1d4-07f9-458e-b169-76f4e5f48cec (2784c1d4-07f9-458e-b169-76f4e5f48cec): created successfully Apr 14 03:17:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c158d2aa-8a9c-4939-9fa3-a34a986121a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Flow 'volume_create_manager' (365b22b1-3489-4485-9c16-be4c07c5c51a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:17:09 user cinder-volume[73403]: INFO cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Created volume successfully. Apr 14 03:17:09 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Creating new image-volume cache entry for image c95b1ea7-6ca2-431a-9f1e-53cb5268b629 on user@joviandss-2#joviandss-2 {{(pid=73403) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Apr 14 03:17:09 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] New image-volume cache entry created: {'id': 2, 'image_id': 'c95b1ea7-6ca2-431a-9f1e-53cb5268b629', 'volume_id': '2784c1d4-07f9-458e-b169-76f4e5f48cec', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 3, 16, 51), 'last_used': datetime.datetime(2023, 4, 14, 3, 17, 9, 963895)}. {{(pid=73403) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Apr 14 03:17:09 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Lock "cinder-c95b1ea7-6ca2-431a-9f1e-53cb5268b629" released by "_prepare_image_cache_entry" :: held 17.755s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:17:09 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Marking volume abd46acc-408d-423d-9d2a-efe1b436150a as bootable. {{(pid=73403) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 03:17:09 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Copying metadata from image c95b1ea7-6ca2-431a-9f1e-53cb5268b629 to abd46acc-408d-423d-9d2a-efe1b436150a. {{(pid=73403) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 03:17:09 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Creating volume glance metadata for volume abd46acc-408d-423d-9d2a-efe1b436150a backed by image c95b1ea7-6ca2-431a-9f1e-53cb5268b629 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c95b1ea7-6ca2-431a-9f1e-53cb5268b629', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '48c58dfa5c05ccb59f51aac1ed84689c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=73403) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 03:17:09 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=66,cinder:UPDATE=25,cinder:DELETE=1,cinder:INSERT=8 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e358de1a-9a41-4bb4-a5ef-4349fdc02c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abd46acc-408d-423d-9d2a-efe1b436150a', 'volume_size': 1, 'image_id': 'c95b1ea7-6ca2-431a-9f1e-53cb5268b629', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '48c58dfa5c05ccb59f51aac1ed84689c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8a7784f55f824aa9ae727c1256dd8656', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1da8a7edf8cee0a2fdfec631f6c3630e30a91083147097f0dc6e4510a179039493c81057ca49f32e9f48db2940265e7691f474ea43114b5267d51290fae8d5b8', 'id': 'c95b1ea7-6ca2-431a-9f1e-53cb5268b629', 'created_at': datetime.datetime(2023, 4, 14, 3, 16, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 3, 16, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c95b1ea7-6ca2-431a-9f1e-53cb5268b629/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945bf680-0666-4606-9c6a-dd1ade0276f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:10 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Volume volume-abd46acc-408d-423d-9d2a-efe1b436150a (abd46acc-408d-423d-9d2a-efe1b436150a): created successfully Apr 14 03:17:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945bf680-0666-4606-9c6a-dd1ade0276f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Flow 'volume_create_manager' (1134927e-8cc5-48b0-8e59-fe7cfe28fd62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:17:10 user cinder-volume[73403]: INFO cinder.volume.manager [None req-e81379af-98de-40af-97e9-ef4415293749 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Created volume successfully. Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.coordination [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Acquiring lock "cinder-abd46acc-408d-423d-9d2a-efe1b436150a-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.coordination [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Lock "cinder-abd46acc-408d-423d-9d2a-efe1b436150a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] remove_export for volume: abd46acc-408d-423d-9d2a-efe1b436150a. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=abd46acc-408d-423d-9d2a-efe1b436150a,launched_at=2023-04-14T03:17:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a7784f55f824aa9ae727c1256dd8656',provider_auth='CHAP nCdIFtaN k249qV0ZpudiDS',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:52Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:17:11Z,updated_at=2023-04-14T03:17:11Z,use_quota=True,user_id='22d4913e9cb349f68d70b9f38ad29aba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0412b0a8-5fb8-4579-894a-4cfc54dd49e6),volume_type_id=0412b0a8-5fb8-4579-894a-4cfc54dd49e6) from target:iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] detach volume v_abd46acc-408d-423d-9d2a-efe1b436150a from target iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a/luns/v_abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a/luns/v_abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a/luns/v_abd46acc-408d-423d-9d2a-efe1b436150a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a/luns/v_abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] failed to remove resource iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a because of JDSS resource v_abd46acc-408d-423d-9d2a-efe1b436150a DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] delete target: iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] delete target iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] failed to remove resource iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a because of JDSS resource iqn.2010-10.org.openstack:abd46acc-408d-423d-9d2a-efe1b436150a DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] deleating volume v_abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] get snapshots for volume v_abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_abd46acc-408d-423d-9d2a-efe1b436150a/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_abd46acc-408d-423d-9d2a-efe1b436150a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '61440', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 05:40:37', 'volsize': '1073741824', 'createtxg': '113728', 'guid': '8716912725006015193', 'compressratio': '4.87', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '61440', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '4.87', 'fscontext': 'none', 'clones': 'Pool-0/v_2784c1d4-07f9-458e-b169-76f4e5f48cec', 'objsetid': '86079', 'name': 'v_2784c1d4-07f9-458e-b169-76f4e5f48cec', 'defer_destroy': 'off', 'san:volume_id': '9f81a403c72ff3e278943a751e225ecf10bb213f', 'mlslabel': 'none', 'logicalreferenced': '159744', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_abd46acc-408d-423d-9d2a-efe1b436150a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:12 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:17:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Flow 'volume_create_manager' (be88f557-c9df-41e4-8d6c-9141415e149e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:17:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c99e00-f434-44b0-a0d4-a1af3d4c91cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] volume v_abd46acc-408d-423d-9d2a-efe1b436150a updated {{(pid=73403) modify_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:267}} Apr 14 03:17:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c99e00-f434-44b0-a0d4-a1af3d4c91cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2015601897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3d3aef82-7760-40c6-82c8-56e4ec7af05f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6feee721287462394fc0c6cd2fe7e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:17:13Z,use_quota=True,user_id='673336bf920941f99b688719b1e1371b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979446d7-5e91-4de8-9284-1df427a71392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979446d7-5e91-4de8-9284-1df427a71392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e6244af-426d-4fd3-b9c3-91f1cae0bff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e6244af-426d-4fd3-b9c3-91f1cae0bff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d3aef82-7760-40c6-82c8-56e4ec7af05f', 'volume_name': 'volume-3d3aef82-7760-40c6-82c8-56e4ec7af05f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf2feae-0119-4caf-9784-01844d3d71ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf2feae-0119-4caf-9784-01844d3d71ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b936aa9-e29b-41e5-bb1d-9035e9d3eedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:12 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Volume 3d3aef82-7760-40c6-82c8-56e4ec7af05f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d3aef82-7760-40c6-82c8-56e4ec7af05f', 'volume_size': 1} Apr 14 03:17:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] creating volume v_3d3aef82-7760-40c6-82c8-56e4ec7af05f. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:17:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] create volume {'name': 'v_3d3aef82-7760-40c6-82c8-56e4ec7af05f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:17:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.quota [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Created reservations ['3eec16d2-281b-4f95-be1e-59c83d39a812', '527f6ca8-36cf-4fa4-84a9-71daceabfa95', '5dea7702-cfb9-4d4e-9ce9-b1e05947d72f', '79dd7bfd-a789-42cb-9562-a6090fe41f59'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.coordination [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Acquiring lock "cinder-2784c1d4-07f9-458e-b169-76f4e5f48cec-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.coordination [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Lock "cinder-2784c1d4-07f9-458e-b169-76f4e5f48cec-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] remove_export for volume: 2784c1d4-07f9-458e-b169-76f4e5f48cec. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] detach volume:Volume(_name_id=None,admin_metadata={readonly='True'},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='image-c95b1ea7-6ca2-431a-9f1e-53cb5268b629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2784c1d4-07f9-458e-b169-76f4e5f48cec,launched_at=2023-04-14T03:17:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e1e7b31d8647499d4f6edae9f171df',provider_auth='CHAP RHTKbtLU IOd7SzwPqc2JsK',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2784c1d4-07f9-458e-b169-76f4e5f48cec 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:52Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=abd46acc-408d-423d-9d2a-efe1b436150a,status='deleting',terminated_at=2023-04-14T03:17:14Z,updated_at=2023-04-14T03:17:14Z,use_quota=True,user_id='22d4913e9cb349f68d70b9f38ad29aba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0412b0a8-5fb8-4579-894a-4cfc54dd49e6),volume_type_id=0412b0a8-5fb8-4579-894a-4cfc54dd49e6) from target:iqn.2010-10.org.openstack:2784c1d4-07f9-458e-b169-76f4e5f48cec. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] detach volume v_2784c1d4-07f9-458e-b169-76f4e5f48cec from target iqn.2010-10.org.openstack:2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2784c1d4-07f9-458e-b169-76f4e5f48cec/luns/v_2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2784c1d4-07f9-458e-b169-76f4e5f48cec/luns/v_2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Geting {'code': 200, 'error': None, 'data': {'available': '114264862720', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.manager [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:17:13 user cinder-volume[73403]: INFO cinder.volume.manager [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Deleted volume successfully. Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.coordination [None req-1d7ca0db-59e6-4131-9725-758c0a59ec84 tempest-VolumeAndVolumeTypeFromImageTest-1390197843 None] Lock "cinder-abd46acc-408d-423d-9d2a-efe1b436150a-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2784c1d4-07f9-458e-b169-76f4e5f48cec not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2784c1d4-07f9-458e-b169-76f4e5f48cec/luns/v_2784c1d4-07f9-458e-b169-76f4e5f48cec'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2784c1d4-07f9-458e-b169-76f4e5f48cec/luns/v_2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] failed to remove resource iqn.2010-10.org.openstack:2784c1d4-07f9-458e-b169-76f4e5f48cec because of JDSS resource v_2784c1d4-07f9-458e-b169-76f4e5f48cec DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] delete target: iqn.2010-10.org.openstack:2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] delete target iqn.2010-10.org.openstack:2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2784c1d4-07f9-458e-b169-76f4e5f48cec not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2784c1d4-07f9-458e-b169-76f4e5f48cec'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] failed to remove resource iqn.2010-10.org.openstack:2784c1d4-07f9-458e-b169-76f4e5f48cec because of JDSS resource iqn.2010-10.org.openstack:2784c1d4-07f9-458e-b169-76f4e5f48cec DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] deleating volume v_2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] get snapshots for volume v_2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2784c1d4-07f9-458e-b169-76f4e5f48cec/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2784c1d4-07f9-458e-b169-76f4e5f48cec/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f', 'is_clone': False, 'name': 'v_3d3aef82-7760-40c6-82c8-56e4ec7af05f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b936aa9-e29b-41e5-bb1d-9035e9d3eedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d3aef82-7760-40c6-82c8-56e4ec7af05f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9a1560-fe53-4646-91a1-f653e0ce2afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:14 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Volume volume-3d3aef82-7760-40c6-82c8-56e4ec7af05f (3d3aef82-7760-40c6-82c8-56e4ec7af05f): created successfully Apr 14 03:17:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9a1560-fe53-4646-91a1-f653e0ce2afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Flow 'volume_create_manager' (be88f557-c9df-41e4-8d6c-9141415e149e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:17:14 user cinder-volume[73403]: INFO cinder.volume.manager [None req-5290899f-034d-4634-9cee-b377ef09a321 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Created volume successfully. Apr 14 03:17:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2784c1d4-07f9-458e-b169-76f4e5f48cec/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] get volume v_2784c1d4-07f9-458e-b169-76f4e5f48cec info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:17:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/t_abd46acc-408d-423d-9d2a-efe1b436150a@v_2784c1d4-07f9-458e-b169-76f4e5f48cec', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2784c1d4-07f9-458e-b169-76f4e5f48cec', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443637', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '61440', 'sharesmb': None, 'createtxg': '113729', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2545877304588140334', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'dce70a46d21dc71b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114264793088', 'san:volume_id': 'dce70a46d21dc71b345f54e686f48b5e1ec83edf', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.87', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '86085', 'name': 'v_2784c1d4-07f9-458e-b169-76f4e5f48cec', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '8192', 'logicalreferenced': '159744', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2784c1d4-07f9-458e-b169-76f4e5f48cec {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] get snapshots for volume t_abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:17:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_abd46acc-408d-423d-9d2a-efe1b436150a/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_abd46acc-408d-423d-9d2a-efe1b436150a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '61440', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 05:40:37', 'volsize': '1073741824', 'createtxg': '113728', 'guid': '8716912725006015193', 'compressratio': '4.87', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '61440', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '4.87', 'fscontext': 'none', 'clones': 'Pool-0/v_2784c1d4-07f9-458e-b169-76f4e5f48cec', 'objsetid': '86079', 'name': 'v_2784c1d4-07f9-458e-b169-76f4e5f48cec', 'defer_destroy': 'off', 'san:volume_id': '9f81a403c72ff3e278943a751e225ecf10bb213f', 'mlslabel': 'none', 'logicalreferenced': '159744', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_abd46acc-408d-423d-9d2a-efe1b436150a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] get volume t_abd46acc-408d-423d-9d2a-efe1b436150a info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:17:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/t_abd46acc-408d-423d-9d2a-efe1b436150a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443623', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '61440', 'sharesmb': None, 'createtxg': '113699', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17029474091026206346', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '159744', 'compressratio': '4.87', 'rootcontext': 'none', 'default_scsi_id': '9f81a403c72ff3e2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114264793088', 'san:volume_id': '9f81a403c72ff3e278943a751e225ecf10bb213f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.87', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '61440', 'objsetid': '85465', 'name': 't_abd46acc-408d-423d-9d2a-efe1b436150a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '61440', 'logicalreferenced': '159744', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] delete volume:t_abd46acc-408d-423d-9d2a-efe1b436150a recursively children:{'recursively_children': True, 'recursively_dependents': True, 'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:17:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d29e973-4c1b-471e-ba19-95351d926a7d tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] create snapshot b1f90b3a-6695-4b49-ae89-3ce7ec2aa093 for volume 3d3aef82-7760-40c6-82c8-56e4ec7af05f {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9d29e973-4c1b-471e-ba19-95351d926a7d tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] cloning v_3d3aef82-7760-40c6-82c8-56e4ec7af05f to s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d29e973-4c1b-471e-ba19-95351d926a7d tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] create snapshot s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d29e973-4c1b-471e-ba19-95351d926a7d tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d29e973-4c1b-471e-ba19-95351d926a7d tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Geting {'code': 500, 'error': {'class': 'opene.storage.zfs.ZfsOeError', 'message': 'In order to delete a zvol, you must delete all of its clones first.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_abd46acc-408d-423d-9d2a-efe1b436150a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_abd46acc-408d-423d-9d2a-efe1b436150a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.coordination [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Lock "cinder-2784c1d4-07f9-458e-b169-76f4e5f48cec-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server [None req-16e58944-dd7e-4dc5-8342-814b1d3e9472 tempest-VolumeAndVolumeTypeFromImageTest-915025031 None] Exception during message handling: KeyError: 'errno' Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 203, in wrapper Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, volume, *args, **kwargs) Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 200, in _synchronized Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server return f(*a, **k) Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/objects/cleanable.py", line 208, in wrapper Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server result = f(*args, **kwargs) Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1035, in delete_volume Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server self.force_reraise() Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server raise self.value Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1026, in delete_volume Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server self.driver.delete_volume(volume) Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 286, in delete_volume Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server self._gc_delete(vname) Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 305, in _gc_delete Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server self._delete_back_recursively(jcom.origin_volume(vol['origin']), Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 374, in _delete_back_recursively Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server self.ra.delete_lun(opvname, Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 360, in delete_lun Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server if resp["error"]["errno"] == 1000: Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server KeyError: 'errno' Apr 14 03:17:15 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.coordination [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Acquiring lock "cinder-7fff5d89-4516-4be1-9698-f088498889ff-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.coordination [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Lock "cinder-7fff5d89-4516-4be1-9698-f088498889ff-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=62,cinder:UPDATE=23,cinder:INSERT=10,cinder:DELETE=5 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] remove_export for volume: 7fff5d89-4516-4be1-9698-f088498889ff. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1347917722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7fff5d89-4516-4be1-9698-f088498889ff,launched_at=2023-04-14T03:13:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82eb4fbf55f04294a3d97800142bdca9',provider_auth='CHAP weNMmovz NGKx8bUglf504k',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:13:51Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:17:16Z,updated_at=2023-04-14T03:17:16Z,use_quota=True,user_id='3c683fe5636b49858857033797ff8e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] detach volume v_7fff5d89-4516-4be1-9698-f088498889ff from target iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff/luns/v_7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff/luns/v_7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff/luns/v_7fff5d89-4516-4be1-9698-f088498889ff'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff/luns/v_7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] failed to remove resource iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff because of JDSS resource v_7fff5d89-4516-4be1-9698-f088498889ff DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] delete target: iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] delete target iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] failed to remove resource iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff because of JDSS resource iqn.2010-10.org.openstack:7fff5d89-4516-4be1-9698-f088498889ff DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] deleating volume v_7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] get snapshots for volume v_7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7fff5d89-4516-4be1-9698-f088498889ff/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7fff5d89-4516-4be1-9698-f088498889ff/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d29e973-4c1b-471e-ba19-95351d926a7d tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d29e973-4c1b-471e-ba19-95351d926a7d tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] create volume s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093 from snapshot s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:17:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d29e973-4c1b-471e-ba19-95351d926a7d tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d29e973-4c1b-471e-ba19-95351d926a7d tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7fff5d89-4516-4be1-9698-f088498889ff/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] get volume v_7fff5d89-4516-4be1-9698-f088498889ff info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:17:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7fff5d89-4516-4be1-9698-f088498889ff', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443440', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113398', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2329834666735721094', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0bbf70a599fb731d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114264780800', 'san:volume_id': '0bbf70a599fb731d5e2d47de43d4ca2e626537b4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85887', 'name': 'v_7fff5d89-4516-4be1-9698-f088498889ff', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] delete volume:v_7fff5d89-4516-4be1-9698-f088498889ff recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:17:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d29e973-4c1b-471e-ba19-95351d926a7d tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f@s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093', 'is_clone': True, 'full_name': 'Pool-0/s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093', 'name': 's_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d29e973-4c1b-471e-ba19-95351d926a7d tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d29e973-4c1b-471e-ba19-95351d926a7d tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9d29e973-4c1b-471e-ba19-95351d926a7d tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9d29e973-4c1b-471e-ba19-95351d926a7d tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] volume s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:17:17 user cinder-volume[73403]: INFO cinder.volume.manager [None req-9d29e973-4c1b-471e-ba19-95351d926a7d tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Create snapshot completed successfully Apr 14 03:17:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7fff5d89-4516-4be1-9698-f088498889ff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] volume v_7fff5d89-4516-4be1-9698-f088498889ff deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:17:18 user cinder-volume[73403]: DEBUG cinder.quota [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Created reservations ['77206135-5f72-4710-ace6-38f31c2f54d9', '67243eeb-b4bd-4d4b-8cf4-b5f345525c9c', '565d8ca5-1f66-4baf-8faf-f1d0c5dd025f', 'c0091de6-74c6-4db6-91c5-f16bf5cb0bd3'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:17:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:17:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:17:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:18 user cinder-volume[73403]: DEBUG cinder.coordination [None req-cdbf89c9-c816-424b-b9fb-34a4d4bffbb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Acquiring lock "cinder-b1f90b3a-6695-4b49-ae89-3ce7ec2aa093-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:17:18 user cinder-volume[73403]: DEBUG cinder.coordination [None req-cdbf89c9-c816-424b-b9fb-34a4d4bffbb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Lock "cinder-b1f90b3a-6695-4b49-ae89-3ce7ec2aa093-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:17:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cdbf89c9-c816-424b-b9fb-34a4d4bffbb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] deleating snapshot s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:17:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cdbf89c9-c816-424b-b9fb-34a4d4bffbb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] get snapshots for volume s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:17:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cdbf89c9-c816-424b-b9fb-34a4d4bffbb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cdbf89c9-c816-424b-b9fb-34a4d4bffbb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Geting {'code': 200, 'error': None, 'data': {'available': '114264862720', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:17:19 user cinder-volume[73403]: DEBUG cinder.manager [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:17:19 user cinder-volume[73403]: INFO cinder.volume.manager [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Deleted volume successfully. Apr 14 03:17:19 user cinder-volume[73403]: DEBUG cinder.coordination [None req-22480823-c148-4233-963b-bccab29bbba9 tempest-ServerStableDeviceRescueTest-1642713032 None] Lock "cinder-7fff5d89-4516-4be1-9698-f088498889ff-delete_volume" released by "delete_volume" :: held 3.199s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:17:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cdbf89c9-c816-424b-b9fb-34a4d4bffbb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cdbf89c9-c816-424b-b9fb-34a4d4bffbb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] get volume s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:17:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cdbf89c9-c816-424b-b9fb-34a4d4bffbb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cdbf89c9-c816-424b-b9fb-34a4d4bffbb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cdbf89c9-c816-424b-b9fb-34a4d4bffbb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f@s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443645', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113740', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3430942812438779433', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '65647b36c0fde952', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114264862720', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86355', 'name': 's_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cdbf89c9-c816-424b-b9fb-34a4d4bffbb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] delete snapshot s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093 of volume v_3d3aef82-7760-40c6-82c8-56e4ec7af05f {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:17:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cdbf89c9-c816-424b-b9fb-34a4d4bffbb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f/snapshots/s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cdbf89c9-c816-424b-b9fb-34a4d4bffbb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f/snapshots/s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cdbf89c9-c816-424b-b9fb-34a4d4bffbb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f/snapshots/s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cdbf89c9-c816-424b-b9fb-34a4d4bffbb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] snapshot s_b1f90b3a-6695-4b49-ae89-3ce7ec2aa093 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:17:20 user cinder-volume[73403]: DEBUG cinder.quota [None req-cdbf89c9-c816-424b-b9fb-34a4d4bffbb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Created reservations ['c235fa8d-4a8f-4e7e-b886-5cb7d57fba1c', '1acba5d2-0584-4aa8-85d3-4a4a9b543527', 'd08720ac-0644-403e-a97f-43b4c5a29687', '752c80f6-5727-4983-acbe-2242c61c028d'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:17:20 user cinder-volume[73403]: INFO cinder.volume.manager [None req-cdbf89c9-c816-424b-b9fb-34a4d4bffbb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Delete snapshot completed successfully. Apr 14 03:17:20 user cinder-volume[73403]: DEBUG cinder.coordination [None req-cdbf89c9-c816-424b-b9fb-34a4d4bffbb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Lock "cinder-b1f90b3a-6695-4b49-ae89-3ce7ec2aa093-delete_snapshot" released by "delete_snapshot" :: held 2.193s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:17:21 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Acquiring lock "cinder-3d3aef82-7760-40c6-82c8-56e4ec7af05f-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:17:21 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Lock "cinder-3d3aef82-7760-40c6-82c8-56e4ec7af05f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:17:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] remove_export for volume: 3d3aef82-7760-40c6-82c8-56e4ec7af05f. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:17:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:17:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2015601897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3d3aef82-7760-40c6-82c8-56e4ec7af05f,launched_at=2023-04-14T03:17:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6feee721287462394fc0c6cd2fe7e38',provider_auth='CHAP wKQnziTR rEkg72ZKimQ61R',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d3aef82-7760-40c6-82c8-56e4ec7af05f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:17:13Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:17:22Z,updated_at=2023-04-14T03:17:22Z,use_quota=True,user_id='673336bf920941f99b688719b1e1371b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:3d3aef82-7760-40c6-82c8-56e4ec7af05f. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:17:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] detach volume v_3d3aef82-7760-40c6-82c8-56e4ec7af05f from target iqn.2010-10.org.openstack:3d3aef82-7760-40c6-82c8-56e4ec7af05f {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:17:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d3aef82-7760-40c6-82c8-56e4ec7af05f/luns/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d3aef82-7760-40c6-82c8-56e4ec7af05f/luns/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3d3aef82-7760-40c6-82c8-56e4ec7af05f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d3aef82-7760-40c6-82c8-56e4ec7af05f/luns/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d3aef82-7760-40c6-82c8-56e4ec7af05f/luns/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] failed to remove resource iqn.2010-10.org.openstack:3d3aef82-7760-40c6-82c8-56e4ec7af05f because of JDSS resource v_3d3aef82-7760-40c6-82c8-56e4ec7af05f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:17:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] delete target: iqn.2010-10.org.openstack:3d3aef82-7760-40c6-82c8-56e4ec7af05f {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:17:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] delete target iqn.2010-10.org.openstack:3d3aef82-7760-40c6-82c8-56e4ec7af05f {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:17:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d3aef82-7760-40c6-82c8-56e4ec7af05f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d3aef82-7760-40c6-82c8-56e4ec7af05f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3d3aef82-7760-40c6-82c8-56e4ec7af05f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d3aef82-7760-40c6-82c8-56e4ec7af05f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3d3aef82-7760-40c6-82c8-56e4ec7af05f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] failed to remove resource iqn.2010-10.org.openstack:3d3aef82-7760-40c6-82c8-56e4ec7af05f because of JDSS resource iqn.2010-10.org.openstack:3d3aef82-7760-40c6-82c8-56e4ec7af05f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:17:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] deleating volume v_3d3aef82-7760-40c6-82c8-56e4ec7af05f {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:17:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] get snapshots for volume v_3d3aef82-7760-40c6-82c8-56e4ec7af05f {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:17:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] get volume v_3d3aef82-7760-40c6-82c8-56e4ec7af05f info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:17:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443642', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113734', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6379308357695222233', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2d2ae8e9194df812', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114264862720', 'san:volume_id': '2d2ae8e9194df8126bd9bc432c5400c1bb402348', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86100', 'name': 'v_3d3aef82-7760-40c6-82c8-56e4ec7af05f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] delete volume:v_3d3aef82-7760-40c6-82c8-56e4ec7af05f recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:17:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3d3aef82-7760-40c6-82c8-56e4ec7af05f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] volume v_3d3aef82-7760-40c6-82c8-56e4ec7af05f deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:17:24 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:INSERT=10,cinder:SELECT=54,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:24 user cinder-volume[73403]: DEBUG cinder.quota [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Created reservations ['05d8199d-22d5-41e7-b31a-7366d4629fdc', 'e2437bba-52d7-4860-b7b1-1c397c4b9ea3', '3b42335b-8c5c-477b-8ddb-65d4cbd86a96', '8bd49148-eabe-4aff-99cc-4cd9c9131cb7'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:17:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:17:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:17:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Geting {'code': 200, 'error': None, 'data': {'available': '114264944640', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:17:25 user cinder-volume[73403]: DEBUG cinder.manager [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:17:25 user cinder-volume[73403]: INFO cinder.volume.manager [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Deleted volume successfully. Apr 14 03:17:25 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e363efde-2b43-4a33-b7e6-0d2897b332cf tempest-VolumeSnapshotQuotasNegativeTestJSON-356166116 None] Lock "cinder-3d3aef82-7760-40c6-82c8-56e4ec7af05f-delete_volume" released by "delete_volume" :: held 3.132s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:17:52 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:DELETE=1,cinder:SELECT=4 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:52 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=42,cinder:UPDATE=30,cinder:INSERT=8 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:17:55 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:17:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Flow 'volume_create_manager' (6f03a4b9-a9b1-4edd-9809-0a2f21e2146d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:17:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89693c88-c5d9-4a2b-aed0-3ecf36a4623d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89693c88-c5d9-4a2b-aed0-3ecf36a4623d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1487293159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e9d830c5-2948-4289-9100-8665b806d340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0096d0892acf4d5f8a0fa290a18b451a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=75429595-9885-4fac-9e0d-9e64e0e61a0c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:17:55Z,use_quota=True,user_id='ba8614e27c65428d92e4bf01969976e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0be74d5-4585-4b50-93c8-2958aabf34ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0be74d5-4585-4b50-93c8-2958aabf34ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180ac32b-6ef5-4390-96d3-2abbcaf060f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180ac32b-6ef5-4390-96d3-2abbcaf060f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e9d830c5-2948-4289-9100-8665b806d340', 'volume_name': 'volume-e9d830c5-2948-4289-9100-8665b806d340', 'volume_size': 1, 'snapshot_id': '75429595-9885-4fac-9e0d-9e64e0e61a0c'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df0a46d-ec1b-445b-9eb0-7605f9dec65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df0a46d-ec1b-445b-9eb0-7605f9dec65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d3447e-e62a-4eb9-8bdc-88f053ebf75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:55 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Volume e9d830c5-2948-4289-9100-8665b806d340: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e9d830c5-2948-4289-9100-8665b806d340', 'volume_size': 1, 'snapshot_id': '75429595-9885-4fac-9e0d-9e64e0e61a0c'} Apr 14 03:17:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] create volume e9d830c5-2948-4289-9100-8665b806d340 from snapshot 75429595-9885-4fac-9e0d-9e64e0e61a0c {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 03:17:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] cloning s_75429595-9885-4fac-9e0d-9e64e0e61a0c to v_e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:17:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] create snapshot v_e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:17:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_75429595-9885-4fac-9e0d-9e64e0e61a0c/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_75429595-9885-4fac-9e0d-9e64e0e61a0c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_e9d830c5-2948-4289-9100-8665b806d340'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_75429595-9885-4fac-9e0d-9e64e0e61a0c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] create volume v_e9d830c5-2948-4289-9100-8665b806d340 from snapshot v_e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:17:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_75429595-9885-4fac-9e0d-9e64e0e61a0c/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_75429595-9885-4fac-9e0d-9e64e0e61a0c/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_75429595-9885-4fac-9e0d-9e64e0e61a0c@v_e9d830c5-2948-4289-9100-8665b806d340', 'is_clone': True, 'full_name': 'Pool-0/v_e9d830c5-2948-4289-9100-8665b806d340', 'name': 'v_e9d830c5-2948-4289-9100-8665b806d340'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_75429595-9885-4fac-9e0d-9e64e0e61a0c/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] get volume v_e9d830c5-2948-4289-9100-8665b806d340 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:17:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_75429595-9885-4fac-9e0d-9e64e0e61a0c@v_e9d830c5-2948-4289-9100-8665b806d340', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e9d830c5-2948-4289-9100-8665b806d340', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443685', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '372736', 'sharesmb': None, 'createtxg': '113758', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17155248426778562786', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b3d054c58c826935', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114264948736', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '5.58', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87061', 'name': 'v_e9d830c5-2948-4289-9100-8665b806d340', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1761280', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d3447e-e62a-4eb9-8bdc-88f053ebf75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d830c5-2948-4289-9100-8665b806d340', 'volume_size': 1, 'snapshot_id': '75429595-9885-4fac-9e0d-9e64e0e61a0c'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ceaf1bf-c24b-406c-930e-6b8c0205578f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:17:57 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Volume volume-e9d830c5-2948-4289-9100-8665b806d340 (e9d830c5-2948-4289-9100-8665b806d340): created successfully Apr 14 03:17:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ceaf1bf-c24b-406c-930e-6b8c0205578f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:17:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Flow 'volume_create_manager' (6f03a4b9-a9b1-4edd-9809-0a2f21e2146d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:17:57 user cinder-volume[73403]: INFO cinder.volume.manager [None req-59a8a5de-e7ef-43bb-becd-973cbc5f4f78 tempest-SnapshotDataIntegrityTests-450991924 None] Created volume successfully. Apr 14 03:17:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] create export for volume: e9d830c5-2948-4289-9100-8665b806d340. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:17:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] ensure volume e9d830c5-2948-4289-9100-8665b806d340 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:17:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] check if targe iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:17:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:17:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:17:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] create target and attach volume e9d830c5-2948-4289-9100-8665b806d340 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:17:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] create target iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:17:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:17:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:18:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:18:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] atach volume v_e9d830c5-2948-4289-9100-8665b806d340 to target iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:18:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:18:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:18:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:18:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:18:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:18:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:18:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:18:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6233643035346335', 'lun': 0, 'mode': 'wt', 'name': 'v_e9d830c5-2948-4289-9100-8665b806d340', 'prod_id': 'Storage', 'scsi_id': 'b3d054c58c826935'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:18:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] add credentails to target iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:18:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:18:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:18:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 201, 'error': None, 'data': {'name': 'dbfZOqJS'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:18:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] initialize_connection for e9d830c5-2948-4289-9100-8665b806d340 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:18:03 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dbfZOqJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'a00befe5-f508-4de2-aa52-3dda9c41ed10'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:18:03 user cinder-volume[73403]: INFO cinder.volume.manager [req-4cb0c5c5-0eb8-4be0-a9f7-7e32060b0c33 req-e2719990-acd4-4dc7-98b9-3bd922a65d24 tempest-SnapshotDataIntegrityTests-450991924 None] attachment_update completed successfully. Apr 14 03:18:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114264924160', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:18:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:18:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:18:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4daf2b34-8ce5-4142-bc76-590d30180088 req-ebf51416-5c3e-419c-b151-3bfa86ac084e tempest-SnapshotDataIntegrityTests-450991924 None] terminate connection for e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:18:08 user cinder-volume[73403]: INFO cinder.volume.manager [req-4daf2b34-8ce5-4142-bc76-590d30180088 req-ebf51416-5c3e-419c-b151-3bfa86ac084e tempest-SnapshotDataIntegrityTests-450991924 None] Terminate volume connection completed successfully. Apr 14 03:18:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-4daf2b34-8ce5-4142-bc76-590d30180088 req-ebf51416-5c3e-419c-b151-3bfa86ac084e tempest-SnapshotDataIntegrityTests-450991924 None] Deleting attachment a00befe5-f508-4de2-aa52-3dda9c41ed10. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:18:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4daf2b34-8ce5-4142-bc76-590d30180088 req-ebf51416-5c3e-419c-b151-3bfa86ac084e tempest-SnapshotDataIntegrityTests-450991924 None] remove_export for volume: e9d830c5-2948-4289-9100-8665b806d340. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:18:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4daf2b34-8ce5-4142-bc76-590d30180088 req-ebf51416-5c3e-419c-b151-3bfa86ac084e tempest-SnapshotDataIntegrityTests-450991924 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:18:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4daf2b34-8ce5-4142-bc76-590d30180088 req-ebf51416-5c3e-419c-b151-3bfa86ac084e tempest-SnapshotDataIntegrityTests-450991924 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1487293159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e9d830c5-2948-4289-9100-8665b806d340,launched_at=2023-04-14T03:17:58Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0096d0892acf4d5f8a0fa290a18b451a',provider_auth='CHAP dbfZOqJS 3gi6yBeMOpl5oZ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:17:55Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=75429595-9885-4fac-9e0d-9e64e0e61a0c,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:18:07Z,use_quota=True,user_id='ba8614e27c65428d92e4bf01969976e7',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:18:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4daf2b34-8ce5-4142-bc76-590d30180088 req-ebf51416-5c3e-419c-b151-3bfa86ac084e tempest-SnapshotDataIntegrityTests-450991924 None] detach volume v_e9d830c5-2948-4289-9100-8665b806d340 from target iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:18:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4daf2b34-8ce5-4142-bc76-590d30180088 req-ebf51416-5c3e-419c-b151-3bfa86ac084e tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340/luns/v_e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:18:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4daf2b34-8ce5-4142-bc76-590d30180088 req-ebf51416-5c3e-419c-b151-3bfa86ac084e tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340/luns/v_e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:18:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4daf2b34-8ce5-4142-bc76-590d30180088 req-ebf51416-5c3e-419c-b151-3bfa86ac084e tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340/luns/v_e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:18:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-4daf2b34-8ce5-4142-bc76-590d30180088 req-ebf51416-5c3e-419c-b151-3bfa86ac084e tempest-SnapshotDataIntegrityTests-450991924 None] delete target: iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:18:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4daf2b34-8ce5-4142-bc76-590d30180088 req-ebf51416-5c3e-419c-b151-3bfa86ac084e tempest-SnapshotDataIntegrityTests-450991924 None] delete target iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:18:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4daf2b34-8ce5-4142-bc76-590d30180088 req-ebf51416-5c3e-419c-b151-3bfa86ac084e tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:18:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4daf2b34-8ce5-4142-bc76-590d30180088 req-ebf51416-5c3e-419c-b151-3bfa86ac084e tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:18:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-4daf2b34-8ce5-4142-bc76-590d30180088 req-ebf51416-5c3e-419c-b151-3bfa86ac084e tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:18:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-4daf2b34-8ce5-4142-bc76-590d30180088 req-ebf51416-5c3e-419c-b151-3bfa86ac084e tempest-SnapshotDataIntegrityTests-450991924 None] target iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:18:18 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=23,cinder:UPDATE=4 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:18:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=25,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:18:52 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:18:57 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:18:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Flow 'volume_create_manager' (7f1463f0-8d2f-4647-b691-4fa7815c613a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:18:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5387c74d-3151-4088-954f-68822ea1af99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:18:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5387c74d-3151-4088-954f-68822ea1af99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-88574320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=64d3b548-9384-41f0-b6cb-e80306d79286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0096d0892acf4d5f8a0fa290a18b451a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7d46d1ed-8a23-45a2-ac5f-405e5afd0b17,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:18:58Z,use_quota=True,user_id='ba8614e27c65428d92e4bf01969976e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:18:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efdff9ee-f2d2-44c2-8747-d7e558abaf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:18:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efdff9ee-f2d2-44c2-8747-d7e558abaf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:18:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10567b3-34f0-4942-a95a-c9d0fa161c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:18:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10567b3-34f0-4942-a95a-c9d0fa161c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '64d3b548-9384-41f0-b6cb-e80306d79286', 'volume_name': 'volume-64d3b548-9384-41f0-b6cb-e80306d79286', 'volume_size': 1, 'snapshot_id': '7d46d1ed-8a23-45a2-ac5f-405e5afd0b17'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:18:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715505cf-fabf-4de9-a797-652e5cb99b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:18:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715505cf-fabf-4de9-a797-652e5cb99b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:18:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca6ec06-2e97-49c7-9cca-a6877616ef47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:18:57 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Volume 64d3b548-9384-41f0-b6cb-e80306d79286: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-64d3b548-9384-41f0-b6cb-e80306d79286', 'volume_size': 1, 'snapshot_id': '7d46d1ed-8a23-45a2-ac5f-405e5afd0b17'} Apr 14 03:18:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] create volume 64d3b548-9384-41f0-b6cb-e80306d79286 from snapshot 7d46d1ed-8a23-45a2-ac5f-405e5afd0b17 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 03:18:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] cloning s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17 to v_64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:18:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] create snapshot v_64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:18:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:18:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:18:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_64d3b548-9384-41f0-b6cb-e80306d79286'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:18:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] create volume v_64d3b548-9384-41f0-b6cb-e80306d79286 from snapshot v_64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:18:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:18:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:18:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17@v_64d3b548-9384-41f0-b6cb-e80306d79286', 'is_clone': True, 'full_name': 'Pool-0/v_64d3b548-9384-41f0-b6cb-e80306d79286', 'name': 'v_64d3b548-9384-41f0-b6cb-e80306d79286'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:18:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] get volume v_64d3b548-9384-41f0-b6cb-e80306d79286 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:18:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:18:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:18:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17@v_64d3b548-9384-41f0-b6cb-e80306d79286', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_64d3b548-9384-41f0-b6cb-e80306d79286', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443748', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '475136', 'sharesmb': None, 'createtxg': '113783', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14011829964146016123', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a35c26c05b7ff170', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114264764416', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.52', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86613', 'name': 'v_64d3b548-9384-41f0-b6cb-e80306d79286', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1892352', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:18:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca6ec06-2e97-49c7-9cca-a6877616ef47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64d3b548-9384-41f0-b6cb-e80306d79286', 'volume_size': 1, 'snapshot_id': '7d46d1ed-8a23-45a2-ac5f-405e5afd0b17'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:18:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf50073-9888-440b-bc2a-2b16b1a555be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:18:59 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Volume volume-64d3b548-9384-41f0-b6cb-e80306d79286 (64d3b548-9384-41f0-b6cb-e80306d79286): created successfully Apr 14 03:18:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf50073-9888-440b-bc2a-2b16b1a555be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:18:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Flow 'volume_create_manager' (7f1463f0-8d2f-4647-b691-4fa7815c613a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:18:59 user cinder-volume[73403]: INFO cinder.volume.manager [None req-4757aa0d-1140-4639-bda8-59ec8ce4d176 tempest-SnapshotDataIntegrityTests-450991924 None] Created volume successfully. Apr 14 03:19:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] create export for volume: 64d3b548-9384-41f0-b6cb-e80306d79286. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:19:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] ensure volume 64d3b548-9384-41f0-b6cb-e80306d79286 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:19:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] check if targe iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:19:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] create target and attach volume 64d3b548-9384-41f0-b6cb-e80306d79286 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:19:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] create target iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:19:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] atach volume v_64d3b548-9384-41f0-b6cb-e80306d79286 to target iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:19:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:19:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:19:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:19:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114264752128', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:19:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:19:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6133356332366330', 'lun': 0, 'mode': 'wt', 'name': 'v_64d3b548-9384-41f0-b6cb-e80306d79286', 'prod_id': 'Storage', 'scsi_id': 'a35c26c05b7ff170'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] add credentails to target iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:19:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 201, 'error': None, 'data': {'name': 'YzwifkRE'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:04 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=15,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] initialize_connection for 64d3b548-9384-41f0-b6cb-e80306d79286 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:19:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YzwifkRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '0e9fa941-9e01-480d-91e5-6cbd3953fca1'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:19:04 user cinder-volume[73403]: INFO cinder.volume.manager [req-6c2e3417-bbaf-40cb-8890-ea87d0461c84 req-ca53fd4f-1941-46ee-a354-0dbcd1c0152f tempest-SnapshotDataIntegrityTests-450991924 None] attachment_update completed successfully. Apr 14 03:19:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 req-4bdda9bb-c983-4eba-8591-308f8bb5eada tempest-SnapshotDataIntegrityTests-450991924 None] terminate connection for 64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:19:09 user cinder-volume[73403]: INFO cinder.volume.manager [req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 req-4bdda9bb-c983-4eba-8591-308f8bb5eada tempest-SnapshotDataIntegrityTests-450991924 None] Terminate volume connection completed successfully. Apr 14 03:19:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 req-4bdda9bb-c983-4eba-8591-308f8bb5eada tempest-SnapshotDataIntegrityTests-450991924 None] Deleting attachment 0e9fa941-9e01-480d-91e5-6cbd3953fca1. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:19:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 req-4bdda9bb-c983-4eba-8591-308f8bb5eada tempest-SnapshotDataIntegrityTests-450991924 None] remove_export for volume: 64d3b548-9384-41f0-b6cb-e80306d79286. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:19:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 req-4bdda9bb-c983-4eba-8591-308f8bb5eada tempest-SnapshotDataIntegrityTests-450991924 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:19:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 req-4bdda9bb-c983-4eba-8591-308f8bb5eada tempest-SnapshotDataIntegrityTests-450991924 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-88574320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=64d3b548-9384-41f0-b6cb-e80306d79286,launched_at=2023-04-14T03:19:00Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0096d0892acf4d5f8a0fa290a18b451a',provider_auth='CHAP YzwifkRE l0BXdSrbLktIgp',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:18:58Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=7d46d1ed-8a23-45a2-ac5f-405e5afd0b17,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:19:08Z,use_quota=True,user_id='ba8614e27c65428d92e4bf01969976e7',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:19:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 req-4bdda9bb-c983-4eba-8591-308f8bb5eada tempest-SnapshotDataIntegrityTests-450991924 None] detach volume v_64d3b548-9384-41f0-b6cb-e80306d79286 from target iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:19:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 req-4bdda9bb-c983-4eba-8591-308f8bb5eada tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286/luns/v_64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 req-4bdda9bb-c983-4eba-8591-308f8bb5eada tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286/luns/v_64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 req-4bdda9bb-c983-4eba-8591-308f8bb5eada tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286/luns/v_64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 req-4bdda9bb-c983-4eba-8591-308f8bb5eada tempest-SnapshotDataIntegrityTests-450991924 None] delete target: iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:19:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 req-4bdda9bb-c983-4eba-8591-308f8bb5eada tempest-SnapshotDataIntegrityTests-450991924 None] delete target iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:19:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 req-4bdda9bb-c983-4eba-8591-308f8bb5eada tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 req-4bdda9bb-c983-4eba-8591-308f8bb5eada tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 req-4bdda9bb-c983-4eba-8591-308f8bb5eada tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6bf1cc2b-8bdd-43d8-a61d-d6e876840d85 req-4bdda9bb-c983-4eba-8591-308f8bb5eada tempest-SnapshotDataIntegrityTests-450991924 None] target iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:19:22 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=29,cinder:UPDATE=4 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:38 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:19:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Flow 'volume_create_manager' (38167293-8b6e-4592-8abc-851dfde13411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:19:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18befe20-bfac-4f21-ab36-cb0f0820e48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:19:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18befe20-bfac-4f21-ab36-cb0f0820e48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1364144328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=96f437f9-4897-417a-95e3-097d2ff29476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd451b3f6734fe3ac0a8e8a853bb9eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:19:39Z,use_quota=True,user_id='12199a43298942898a2e694ee2c5230e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:19:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46f5406-34a2-47c7-a69b-bd7741d5e2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:19:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46f5406-34a2-47c7-a69b-bd7741d5e2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:19:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f00d4b-f57f-491f-a30c-6d068cf027c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:19:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f00d4b-f57f-491f-a30c-6d068cf027c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96f437f9-4897-417a-95e3-097d2ff29476', 'volume_name': 'volume-96f437f9-4897-417a-95e3-097d2ff29476', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:19:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9540e64a-0d26-43e7-9616-7aceab8f78eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:19:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9540e64a-0d26-43e7-9616-7aceab8f78eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:19:38 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6036fc-c4d8-416c-803b-bc2f4cc39a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:19:38 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Volume 96f437f9-4897-417a-95e3-097d2ff29476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96f437f9-4897-417a-95e3-097d2ff29476', 'volume_size': 1} Apr 14 03:19:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] creating volume v_96f437f9-4897-417a-95e3-097d2ff29476. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:19:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] create volume {'name': 'v_96f437f9-4897-417a-95e3-097d2ff29476', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:19:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_96f437f9-4897-417a-95e3-097d2ff29476', 'is_clone': False, 'name': 'v_96f437f9-4897-417a-95e3-097d2ff29476'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6036fc-c4d8-416c-803b-bc2f4cc39a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f437f9-4897-417a-95e3-097d2ff29476', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:19:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66228354-48bd-471b-92b1-1b71e6feb5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:19:39 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Volume volume-96f437f9-4897-417a-95e3-097d2ff29476 (96f437f9-4897-417a-95e3-097d2ff29476): created successfully Apr 14 03:19:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66228354-48bd-471b-92b1-1b71e6feb5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:19:39 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Flow 'volume_create_manager' (38167293-8b6e-4592-8abc-851dfde13411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:19:39 user cinder-volume[73403]: INFO cinder.volume.manager [None req-7f3e05b2-8556-483c-810a-563e7569a9c3 tempest-TestMinimumBasicScenario-144187586 None] Created volume successfully. Apr 14 03:19:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] create export for volume: 96f437f9-4897-417a-95e3-097d2ff29476. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:19:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] ensure volume 96f437f9-4897-417a-95e3-097d2ff29476 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:19:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] check if targe iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:19:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] create target and attach volume 96f437f9-4897-417a-95e3-097d2ff29476 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:19:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] create target iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:19:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] atach volume v_96f437f9-4897-417a-95e3-097d2ff29476 to target iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:19:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3737626134303438', 'lun': 0, 'mode': 'wt', 'name': 'v_96f437f9-4897-417a-95e3-097d2ff29476', 'prod_id': 'Storage', 'scsi_id': '77ba4048fe052f03'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] add credentails to target iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:19:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 201, 'error': None, 'data': {'name': 'JTPOdpZX'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] initialize_connection for 96f437f9-4897-417a-95e3-097d2ff29476 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:19:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JTPOdpZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'bca5b8c8-48bf-4f16-a19b-3e953f04cdc1'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:19:44 user cinder-volume[73403]: INFO cinder.volume.manager [req-5c78ea36-935b-4ba8-bd6a-b9b75fee2035 req-8ebd89db-57ee-40c3-838c-c5e23901a88f tempest-TestMinimumBasicScenario-144187586 None] attachment_update completed successfully. Apr 14 03:19:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-140ac692-5bc3-4eec-ad0b-4018e61ffe30 tempest-TestMinimumBasicScenario-144187586 None] create snapshot 6755e5b7-ddf7-4059-ae10-164aab1f8439 for volume 96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:19:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-140ac692-5bc3-4eec-ad0b-4018e61ffe30 tempest-TestMinimumBasicScenario-144187586 None] cloning v_96f437f9-4897-417a-95e3-097d2ff29476 to s_6755e5b7-ddf7-4059-ae10-164aab1f8439 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:19:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-140ac692-5bc3-4eec-ad0b-4018e61ffe30 tempest-TestMinimumBasicScenario-144187586 None] create snapshot s_6755e5b7-ddf7-4059-ae10-164aab1f8439 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:19:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-140ac692-5bc3-4eec-ad0b-4018e61ffe30 tempest-TestMinimumBasicScenario-144187586 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96f437f9-4897-417a-95e3-097d2ff29476/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-140ac692-5bc3-4eec-ad0b-4018e61ffe30 tempest-TestMinimumBasicScenario-144187586 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96f437f9-4897-417a-95e3-097d2ff29476/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-140ac692-5bc3-4eec-ad0b-4018e61ffe30 tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_6755e5b7-ddf7-4059-ae10-164aab1f8439'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96f437f9-4897-417a-95e3-097d2ff29476/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-140ac692-5bc3-4eec-ad0b-4018e61ffe30 tempest-TestMinimumBasicScenario-144187586 None] create volume s_6755e5b7-ddf7-4059-ae10-164aab1f8439 from snapshot s_6755e5b7-ddf7-4059-ae10-164aab1f8439 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:19:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-140ac692-5bc3-4eec-ad0b-4018e61ffe30 tempest-TestMinimumBasicScenario-144187586 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96f437f9-4897-417a-95e3-097d2ff29476/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-140ac692-5bc3-4eec-ad0b-4018e61ffe30 tempest-TestMinimumBasicScenario-144187586 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96f437f9-4897-417a-95e3-097d2ff29476/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-140ac692-5bc3-4eec-ad0b-4018e61ffe30 tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_96f437f9-4897-417a-95e3-097d2ff29476@s_6755e5b7-ddf7-4059-ae10-164aab1f8439', 'is_clone': True, 'full_name': 'Pool-0/s_6755e5b7-ddf7-4059-ae10-164aab1f8439', 'name': 's_6755e5b7-ddf7-4059-ae10-164aab1f8439'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96f437f9-4897-417a-95e3-097d2ff29476/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-140ac692-5bc3-4eec-ad0b-4018e61ffe30 tempest-TestMinimumBasicScenario-144187586 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6755e5b7-ddf7-4059-ae10-164aab1f8439/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-140ac692-5bc3-4eec-ad0b-4018e61ffe30 tempest-TestMinimumBasicScenario-144187586 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6755e5b7-ddf7-4059-ae10-164aab1f8439/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-140ac692-5bc3-4eec-ad0b-4018e61ffe30 tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6755e5b7-ddf7-4059-ae10-164aab1f8439/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-140ac692-5bc3-4eec-ad0b-4018e61ffe30 tempest-TestMinimumBasicScenario-144187586 None] volume s_6755e5b7-ddf7-4059-ae10-164aab1f8439 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:19:50 user cinder-volume[73403]: INFO cinder.volume.manager [None req-140ac692-5bc3-4eec-ad0b-4018e61ffe30 tempest-TestMinimumBasicScenario-144187586 None] Create snapshot completed successfully Apr 14 03:19:55 user cinder-volume[73403]: DEBUG cinder.coordination [None req-89fdebd9-3359-4e05-a540-ab1437f15aaf tempest-TestMinimumBasicScenario-144187586 None] Acquiring lock "cinder-6755e5b7-ddf7-4059-ae10-164aab1f8439-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:19:55 user cinder-volume[73403]: DEBUG cinder.coordination [None req-89fdebd9-3359-4e05-a540-ab1437f15aaf tempest-TestMinimumBasicScenario-144187586 None] Lock "cinder-6755e5b7-ddf7-4059-ae10-164aab1f8439-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:19:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-89fdebd9-3359-4e05-a540-ab1437f15aaf tempest-TestMinimumBasicScenario-144187586 None] deleating snapshot s_6755e5b7-ddf7-4059-ae10-164aab1f8439. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:19:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89fdebd9-3359-4e05-a540-ab1437f15aaf tempest-TestMinimumBasicScenario-144187586 None] get snapshots for volume s_6755e5b7-ddf7-4059-ae10-164aab1f8439 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:19:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89fdebd9-3359-4e05-a540-ab1437f15aaf tempest-TestMinimumBasicScenario-144187586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6755e5b7-ddf7-4059-ae10-164aab1f8439/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89fdebd9-3359-4e05-a540-ab1437f15aaf tempest-TestMinimumBasicScenario-144187586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6755e5b7-ddf7-4059-ae10-164aab1f8439/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89fdebd9-3359-4e05-a540-ab1437f15aaf tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6755e5b7-ddf7-4059-ae10-164aab1f8439/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89fdebd9-3359-4e05-a540-ab1437f15aaf tempest-TestMinimumBasicScenario-144187586 None] get volume s_6755e5b7-ddf7-4059-ae10-164aab1f8439 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:19:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89fdebd9-3359-4e05-a540-ab1437f15aaf tempest-TestMinimumBasicScenario-144187586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6755e5b7-ddf7-4059-ae10-164aab1f8439 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89fdebd9-3359-4e05-a540-ab1437f15aaf tempest-TestMinimumBasicScenario-144187586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6755e5b7-ddf7-4059-ae10-164aab1f8439 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89fdebd9-3359-4e05-a540-ab1437f15aaf tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_96f437f9-4897-417a-95e3-097d2ff29476@s_6755e5b7-ddf7-4059-ae10-164aab1f8439', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_6755e5b7-ddf7-4059-ae10-164aab1f8439', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443798', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113811', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3654132673796524333', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5cc13c4e7c616f7a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114264498176', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86113', 'name': 's_6755e5b7-ddf7-4059-ae10-164aab1f8439', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_6755e5b7-ddf7-4059-ae10-164aab1f8439 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89fdebd9-3359-4e05-a540-ab1437f15aaf tempest-TestMinimumBasicScenario-144187586 None] delete snapshot s_6755e5b7-ddf7-4059-ae10-164aab1f8439 of volume v_96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:19:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89fdebd9-3359-4e05-a540-ab1437f15aaf tempest-TestMinimumBasicScenario-144187586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96f437f9-4897-417a-95e3-097d2ff29476/snapshots/s_6755e5b7-ddf7-4059-ae10-164aab1f8439 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89fdebd9-3359-4e05-a540-ab1437f15aaf tempest-TestMinimumBasicScenario-144187586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96f437f9-4897-417a-95e3-097d2ff29476/snapshots/s_6755e5b7-ddf7-4059-ae10-164aab1f8439 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-89fdebd9-3359-4e05-a540-ab1437f15aaf tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96f437f9-4897-417a-95e3-097d2ff29476/snapshots/s_6755e5b7-ddf7-4059-ae10-164aab1f8439 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-89fdebd9-3359-4e05-a540-ab1437f15aaf tempest-TestMinimumBasicScenario-144187586 None] snapshot s_6755e5b7-ddf7-4059-ae10-164aab1f8439 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:19:57 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=24,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:19:57 user cinder-volume[73403]: DEBUG cinder.quota [None req-89fdebd9-3359-4e05-a540-ab1437f15aaf tempest-TestMinimumBasicScenario-144187586 None] Created reservations ['059c5d50-0554-4f0a-a863-86e7ce6d08d5', '6f83573d-dcd4-4491-ac00-9e450efe9f56', '4978fe59-0449-4d94-a198-90ca30f7513b', '812fc1bd-d7cc-4ca5-b35a-201d91dc577b'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:19:57 user cinder-volume[73403]: INFO cinder.volume.manager [None req-89fdebd9-3359-4e05-a540-ab1437f15aaf tempest-TestMinimumBasicScenario-144187586 None] Delete snapshot completed successfully. Apr 14 03:19:57 user cinder-volume[73403]: DEBUG cinder.coordination [None req-89fdebd9-3359-4e05-a540-ab1437f15aaf tempest-TestMinimumBasicScenario-144187586 None] Lock "cinder-6755e5b7-ddf7-4059-ae10-164aab1f8439-delete_snapshot" released by "delete_snapshot" :: held 2.173s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:19:58 user cinder-volume[73403]: DEBUG cinder.coordination [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Acquiring lock "cinder-64d3b548-9384-41f0-b6cb-e80306d79286-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:19:58 user cinder-volume[73403]: DEBUG cinder.coordination [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Lock "cinder-64d3b548-9384-41f0-b6cb-e80306d79286-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:19:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] remove_export for volume: 64d3b548-9384-41f0-b6cb-e80306d79286. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:19:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:19:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-88574320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=64d3b548-9384-41f0-b6cb-e80306d79286,launched_at=2023-04-14T03:19:00Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0096d0892acf4d5f8a0fa290a18b451a',provider_auth='CHAP YzwifkRE l0BXdSrbLktIgp',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:18:58Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=7d46d1ed-8a23-45a2-ac5f-405e5afd0b17,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:19:59Z,updated_at=2023-04-14T03:19:59Z,use_quota=True,user_id='ba8614e27c65428d92e4bf01969976e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:19:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] detach volume v_64d3b548-9384-41f0-b6cb-e80306d79286 from target iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:19:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286/luns/v_64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286/luns/v_64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286/luns/v_64d3b548-9384-41f0-b6cb-e80306d79286'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286/luns/v_64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] failed to remove resource iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 because of JDSS resource v_64d3b548-9384-41f0-b6cb-e80306d79286 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:19:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] delete target: iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:19:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] delete target iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:19:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] failed to remove resource iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 because of JDSS resource iqn.2010-10.org.openstack:64d3b548-9384-41f0-b6cb-e80306d79286 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:19:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] deleating volume v_64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:19:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] get snapshots for volume v_64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:19:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64d3b548-9384-41f0-b6cb-e80306d79286/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64d3b548-9384-41f0-b6cb-e80306d79286/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64d3b548-9384-41f0-b6cb-e80306d79286/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] get volume v_64d3b548-9384-41f0-b6cb-e80306d79286 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:19:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:19:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17@v_64d3b548-9384-41f0-b6cb-e80306d79286', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_64d3b548-9384-41f0-b6cb-e80306d79286', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443748', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '475136', 'sharesmb': None, 'createtxg': '113783', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14011829964146016123', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '94208', 'logicalused': '434176', 'compressratio': '8.15', 'rootcontext': 'none', 'default_scsi_id': 'a35c26c05b7ff170', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114264498176', 'san:volume_id': 'a35c26c05b7ff1709ebbbe7c07aab62d3cc55cf3', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.52', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '94208', 'objsetid': '86613', 'name': 'v_64d3b548-9384-41f0-b6cb-e80306d79286', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '94208', 'logicalreferenced': '1892352', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:19:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] delete snapshot v_64d3b548-9384-41f0-b6cb-e80306d79286 of volume s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:19:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17/snapshots/v_64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:19:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17/snapshots/v_64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17/snapshots/v_64d3b548-9384-41f0-b6cb-e80306d79286 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] snapshot v_64d3b548-9384-41f0-b6cb-e80306d79286 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:20:01 user cinder-volume[73403]: DEBUG cinder.quota [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Created reservations ['b26ccbee-f169-42cf-9609-e069a00d9973', '06dc35a3-8c94-48e3-9df5-2c96880d2e2a', '55ec93b6-8a57-42c6-8156-1161a5536337', '0d164cce-5e36-4610-80b0-2613b3e43a8e'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:20:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:20:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:20:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'available': '114264649728', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:20:01 user cinder-volume[73403]: DEBUG cinder.manager [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:20:01 user cinder-volume[73403]: INFO cinder.volume.manager [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Deleted volume successfully. Apr 14 03:20:01 user cinder-volume[73403]: DEBUG cinder.coordination [None req-aff44beb-795e-428f-9013-440c452b867e tempest-SnapshotDataIntegrityTests-450991924 None] Lock "cinder-64d3b548-9384-41f0-b6cb-e80306d79286-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Acquiring lock "cinder-e9d830c5-2948-4289-9100-8665b806d340-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Lock "cinder-e9d830c5-2948-4289-9100-8665b806d340-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] remove_export for volume: e9d830c5-2948-4289-9100-8665b806d340. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1487293159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e9d830c5-2948-4289-9100-8665b806d340,launched_at=2023-04-14T03:17:58Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0096d0892acf4d5f8a0fa290a18b451a',provider_auth='CHAP dbfZOqJS 3gi6yBeMOpl5oZ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:17:55Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=75429595-9885-4fac-9e0d-9e64e0e61a0c,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:20:02Z,updated_at=2023-04-14T03:20:02Z,use_quota=True,user_id='ba8614e27c65428d92e4bf01969976e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] detach volume v_e9d830c5-2948-4289-9100-8665b806d340 from target iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340/luns/v_e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340/luns/v_e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340/luns/v_e9d830c5-2948-4289-9100-8665b806d340'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340/luns/v_e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] failed to remove resource iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 because of JDSS resource v_e9d830c5-2948-4289-9100-8665b806d340 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] delete target: iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] delete target iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] failed to remove resource iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 because of JDSS resource iqn.2010-10.org.openstack:e9d830c5-2948-4289-9100-8665b806d340 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] deleating volume v_e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] get snapshots for volume v_e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e9d830c5-2948-4289-9100-8665b806d340/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e9d830c5-2948-4289-9100-8665b806d340/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e9d830c5-2948-4289-9100-8665b806d340/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] get volume v_e9d830c5-2948-4289-9100-8665b806d340 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_75429595-9885-4fac-9e0d-9e64e0e61a0c@v_e9d830c5-2948-4289-9100-8665b806d340', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e9d830c5-2948-4289-9100-8665b806d340', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443685', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '372736', 'sharesmb': None, 'createtxg': '113758', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17155248426778562786', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '94208', 'logicalused': '434176', 'compressratio': '8.15', 'rootcontext': 'none', 'default_scsi_id': 'b3d054c58c826935', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114264649728', 'san:volume_id': 'b3d054c58c826935449e50304c338a8e4440191f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '5.58', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '94208', 'objsetid': '87061', 'name': 'v_e9d830c5-2948-4289-9100-8665b806d340', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '94208', 'logicalreferenced': '1761280', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] delete snapshot v_e9d830c5-2948-4289-9100-8665b806d340 of volume s_75429595-9885-4fac-9e0d-9e64e0e61a0c {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_75429595-9885-4fac-9e0d-9e64e0e61a0c/snapshots/v_e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_75429595-9885-4fac-9e0d-9e64e0e61a0c/snapshots/v_e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:20:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:20:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:20:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114264649728', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:20:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:20:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_75429595-9885-4fac-9e0d-9e64e0e61a0c/snapshots/v_e9d830c5-2948-4289-9100-8665b806d340 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] snapshot v_e9d830c5-2948-4289-9100-8665b806d340 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:20:04 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=52,cinder:UPDATE=22,cinder:DELETE=2,cinder:INSERT=7 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:04 user cinder-volume[73403]: DEBUG cinder.quota [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Created reservations ['f69cc6bd-b81a-4ec0-b1a1-7c7ce185a4b7', '6ba4d7d0-ba3f-4fba-a572-d0f5a5f151cf', 'b5cd1a3c-72c8-489e-a295-8134de6aecdc', 'd9cfeb73-bbf1-41c3-9a55-974c81d4ab47'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:20:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:20:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:20:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'available': '114264805376', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.manager [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:20:05 user cinder-volume[73403]: INFO cinder.volume.manager [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Deleted volume successfully. Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7baec86f-bc5c-449c-9430-1847ca745b9c tempest-SnapshotDataIntegrityTests-450991924 None] Lock "cinder-e9d830c5-2948-4289-9100-8665b806d340-delete_volume" released by "delete_volume" :: held 3.105s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Acquiring lock "cinder-972ac1b0-8c90-4a59-a53a-92321048d947-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Lock "cinder-972ac1b0-8c90-4a59-a53a-92321048d947-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] remove_export for volume: 972ac1b0-8c90-4a59-a53a-92321048d947. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-796863111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=972ac1b0-8c90-4a59-a53a-92321048d947,launched_at=2023-04-14T03:16:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0096d0892acf4d5f8a0fa290a18b451a',provider_auth='CHAP BqELIMHk 3b5wTlGSiezVs2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:51Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=341ddf1e-6211-421f-93dd-c1b4599e2085,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:20:06Z,updated_at=2023-04-14T03:20:06Z,use_quota=True,user_id='ba8614e27c65428d92e4bf01969976e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] detach volume v_972ac1b0-8c90-4a59-a53a-92321048d947 from target iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947/luns/v_972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947/luns/v_972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947/luns/v_972ac1b0-8c90-4a59-a53a-92321048d947'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947/luns/v_972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] failed to remove resource iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 because of JDSS resource v_972ac1b0-8c90-4a59-a53a-92321048d947 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] delete target: iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] delete target iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] failed to remove resource iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 because of JDSS resource iqn.2010-10.org.openstack:972ac1b0-8c90-4a59-a53a-92321048d947 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] deleating volume v_972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] get snapshots for volume v_972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_972ac1b0-8c90-4a59-a53a-92321048d947/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_972ac1b0-8c90-4a59-a53a-92321048d947/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_972ac1b0-8c90-4a59-a53a-92321048d947/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] get volume v_972ac1b0-8c90-4a59-a53a-92321048d947 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:20:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_341ddf1e-6211-421f-93dd-c1b4599e2085@v_972ac1b0-8c90-4a59-a53a-92321048d947', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_972ac1b0-8c90-4a59-a53a-92321048d947', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443621', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '266240', 'sharesmb': None, 'createtxg': '113693', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10461941340769055764', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '94208', 'logicalused': '434176', 'compressratio': '8.15', 'rootcontext': 'none', 'default_scsi_id': 'c7de50823280b058', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114264805376', 'san:volume_id': 'c7de50823280b0586b42d29c80f1f3810168dec5', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '7.80', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '94208', 'objsetid': '86448', 'name': 'v_972ac1b0-8c90-4a59-a53a-92321048d947', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '94208', 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] delete snapshot v_972ac1b0-8c90-4a59-a53a-92321048d947 of volume s_341ddf1e-6211-421f-93dd-c1b4599e2085 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:20:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_341ddf1e-6211-421f-93dd-c1b4599e2085/snapshots/v_972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_341ddf1e-6211-421f-93dd-c1b4599e2085/snapshots/v_972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_341ddf1e-6211-421f-93dd-c1b4599e2085/snapshots/v_972ac1b0-8c90-4a59-a53a-92321048d947 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] snapshot v_972ac1b0-8c90-4a59-a53a-92321048d947 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:20:07 user cinder-volume[73403]: DEBUG cinder.quota [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Created reservations ['d919d7d5-0705-4c4d-b33d-3de617342014', '6ba3b385-9669-4f03-bebb-07cb93882aef', '33474e48-0bbe-4bbd-848d-da107ab2e24e', '71e3a97b-dc76-468d-87cc-3c9aba2fc1b6'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:20:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:20:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:20:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'available': '114264948736', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:20:08 user cinder-volume[73403]: DEBUG cinder.manager [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:20:08 user cinder-volume[73403]: INFO cinder.volume.manager [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Deleted volume successfully. Apr 14 03:20:08 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7662bbad-22ba-4e05-8bb1-cb8d3c8c2835 tempest-SnapshotDataIntegrityTests-450991924 None] Lock "cinder-972ac1b0-8c90-4a59-a53a-92321048d947-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:20:08 user cinder-volume[73403]: DEBUG cinder.coordination [None req-fec90887-06cf-478e-ac34-d29bc13abfdc tempest-SnapshotDataIntegrityTests-450991924 None] Acquiring lock "cinder-7d46d1ed-8a23-45a2-ac5f-405e5afd0b17-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:20:08 user cinder-volume[73403]: DEBUG cinder.coordination [None req-fec90887-06cf-478e-ac34-d29bc13abfdc tempest-SnapshotDataIntegrityTests-450991924 None] Lock "cinder-7d46d1ed-8a23-45a2-ac5f-405e5afd0b17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:20:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fec90887-06cf-478e-ac34-d29bc13abfdc tempest-SnapshotDataIntegrityTests-450991924 None] deleating snapshot s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:20:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fec90887-06cf-478e-ac34-d29bc13abfdc tempest-SnapshotDataIntegrityTests-450991924 None] get snapshots for volume s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:20:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fec90887-06cf-478e-ac34-d29bc13abfdc tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fec90887-06cf-478e-ac34-d29bc13abfdc tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fec90887-06cf-478e-ac34-d29bc13abfdc tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fec90887-06cf-478e-ac34-d29bc13abfdc tempest-SnapshotDataIntegrityTests-450991924 None] get volume s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:20:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fec90887-06cf-478e-ac34-d29bc13abfdc tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fec90887-06cf-478e-ac34-d29bc13abfdc tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fec90887-06cf-478e-ac34-d29bc13abfdc tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e@s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443566', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '475136', 'sharesmb': None, 'createtxg': '113576', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17979160364070996309', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3775dd187eb62d93', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114264948736', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.52', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '85342', 'name': 's_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1892352', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fec90887-06cf-478e-ac34-d29bc13abfdc tempest-SnapshotDataIntegrityTests-450991924 None] delete snapshot s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17 of volume v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:20:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fec90887-06cf-478e-ac34-d29bc13abfdc tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fec90887-06cf-478e-ac34-d29bc13abfdc tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fec90887-06cf-478e-ac34-d29bc13abfdc tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots/s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fec90887-06cf-478e-ac34-d29bc13abfdc tempest-SnapshotDataIntegrityTests-450991924 None] snapshot s_7d46d1ed-8a23-45a2-ac5f-405e5afd0b17 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:20:11 user cinder-volume[73403]: DEBUG cinder.quota [None req-fec90887-06cf-478e-ac34-d29bc13abfdc tempest-SnapshotDataIntegrityTests-450991924 None] Created reservations ['8c3c0683-622e-486b-8408-3c958c8860fd', '99fad093-3339-4ebe-a140-7e3308df432c', 'a41d9e14-060e-4482-bf90-b5e39179c000', '1c9f1fe8-c1ae-4a27-8c98-6709cc20d4bf'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:20:11 user cinder-volume[73403]: INFO cinder.volume.manager [None req-fec90887-06cf-478e-ac34-d29bc13abfdc tempest-SnapshotDataIntegrityTests-450991924 None] Delete snapshot completed successfully. Apr 14 03:20:11 user cinder-volume[73403]: DEBUG cinder.coordination [None req-fec90887-06cf-478e-ac34-d29bc13abfdc tempest-SnapshotDataIntegrityTests-450991924 None] Lock "cinder-7d46d1ed-8a23-45a2-ac5f-405e5afd0b17-delete_snapshot" released by "delete_snapshot" :: held 2.453s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:20:11 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8c70258f-b036-491d-af72-36cd20423d8c tempest-SnapshotDataIntegrityTests-450991924 None] Acquiring lock "cinder-75429595-9885-4fac-9e0d-9e64e0e61a0c-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:20:11 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8c70258f-b036-491d-af72-36cd20423d8c tempest-SnapshotDataIntegrityTests-450991924 None] Lock "cinder-75429595-9885-4fac-9e0d-9e64e0e61a0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:20:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8c70258f-b036-491d-af72-36cd20423d8c tempest-SnapshotDataIntegrityTests-450991924 None] deleating snapshot s_75429595-9885-4fac-9e0d-9e64e0e61a0c. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:20:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8c70258f-b036-491d-af72-36cd20423d8c tempest-SnapshotDataIntegrityTests-450991924 None] get snapshots for volume s_75429595-9885-4fac-9e0d-9e64e0e61a0c {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:20:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c70258f-b036-491d-af72-36cd20423d8c tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_75429595-9885-4fac-9e0d-9e64e0e61a0c/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c70258f-b036-491d-af72-36cd20423d8c tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_75429595-9885-4fac-9e0d-9e64e0e61a0c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c70258f-b036-491d-af72-36cd20423d8c tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_75429595-9885-4fac-9e0d-9e64e0e61a0c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8c70258f-b036-491d-af72-36cd20423d8c tempest-SnapshotDataIntegrityTests-450991924 None] get volume s_75429595-9885-4fac-9e0d-9e64e0e61a0c info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:20:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c70258f-b036-491d-af72-36cd20423d8c tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_75429595-9885-4fac-9e0d-9e64e0e61a0c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c70258f-b036-491d-af72-36cd20423d8c tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_75429595-9885-4fac-9e0d-9e64e0e61a0c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c70258f-b036-491d-af72-36cd20423d8c tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e@s_75429595-9885-4fac-9e0d-9e64e0e61a0c', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_75429595-9885-4fac-9e0d-9e64e0e61a0c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443559', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '372736', 'sharesmb': None, 'createtxg': '113552', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18026287413713036060', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1699ce895668429e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265006080', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '5.58', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '86704', 'name': 's_75429595-9885-4fac-9e0d-9e64e0e61a0c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1761280', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_75429595-9885-4fac-9e0d-9e64e0e61a0c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8c70258f-b036-491d-af72-36cd20423d8c tempest-SnapshotDataIntegrityTests-450991924 None] delete snapshot s_75429595-9885-4fac-9e0d-9e64e0e61a0c of volume v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:20:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c70258f-b036-491d-af72-36cd20423d8c tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots/s_75429595-9885-4fac-9e0d-9e64e0e61a0c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c70258f-b036-491d-af72-36cd20423d8c tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots/s_75429595-9885-4fac-9e0d-9e64e0e61a0c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c70258f-b036-491d-af72-36cd20423d8c tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots/s_75429595-9885-4fac-9e0d-9e64e0e61a0c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8c70258f-b036-491d-af72-36cd20423d8c tempest-SnapshotDataIntegrityTests-450991924 None] snapshot s_75429595-9885-4fac-9e0d-9e64e0e61a0c deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:20:14 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=57,cinder:INSERT=10,cinder:UPDATE=32,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:14 user cinder-volume[73403]: DEBUG cinder.quota [None req-8c70258f-b036-491d-af72-36cd20423d8c tempest-SnapshotDataIntegrityTests-450991924 None] Created reservations ['997860c1-2e33-409d-b656-bab7f5abb6d7', 'f394c374-e60c-4780-8799-e99981d0728e', 'e13f2a2c-be95-4c3a-9db9-eec68430bed8', '9cc3ebed-6d69-477a-a5f9-44b3cedbb8fb'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:20:14 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8c70258f-b036-491d-af72-36cd20423d8c tempest-SnapshotDataIntegrityTests-450991924 None] Delete snapshot completed successfully. Apr 14 03:20:14 user cinder-volume[73403]: DEBUG cinder.coordination [None req-8c70258f-b036-491d-af72-36cd20423d8c tempest-SnapshotDataIntegrityTests-450991924 None] Lock "cinder-75429595-9885-4fac-9e0d-9e64e0e61a0c-delete_snapshot" released by "delete_snapshot" :: held 2.394s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:20:15 user cinder-volume[73403]: DEBUG cinder.coordination [None req-d9234ba5-0cc0-46dd-9ae3-a985159ea2a6 tempest-SnapshotDataIntegrityTests-450991924 None] Acquiring lock "cinder-341ddf1e-6211-421f-93dd-c1b4599e2085-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:20:15 user cinder-volume[73403]: DEBUG cinder.coordination [None req-d9234ba5-0cc0-46dd-9ae3-a985159ea2a6 tempest-SnapshotDataIntegrityTests-450991924 None] Lock "cinder-341ddf1e-6211-421f-93dd-c1b4599e2085-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:20:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9234ba5-0cc0-46dd-9ae3-a985159ea2a6 tempest-SnapshotDataIntegrityTests-450991924 None] deleating snapshot s_341ddf1e-6211-421f-93dd-c1b4599e2085. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:20:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9234ba5-0cc0-46dd-9ae3-a985159ea2a6 tempest-SnapshotDataIntegrityTests-450991924 None] get snapshots for volume s_341ddf1e-6211-421f-93dd-c1b4599e2085 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:20:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9234ba5-0cc0-46dd-9ae3-a985159ea2a6 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_341ddf1e-6211-421f-93dd-c1b4599e2085/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9234ba5-0cc0-46dd-9ae3-a985159ea2a6 tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_341ddf1e-6211-421f-93dd-c1b4599e2085/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9234ba5-0cc0-46dd-9ae3-a985159ea2a6 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_341ddf1e-6211-421f-93dd-c1b4599e2085/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9234ba5-0cc0-46dd-9ae3-a985159ea2a6 tempest-SnapshotDataIntegrityTests-450991924 None] get volume s_341ddf1e-6211-421f-93dd-c1b4599e2085 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:20:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9234ba5-0cc0-46dd-9ae3-a985159ea2a6 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_341ddf1e-6211-421f-93dd-c1b4599e2085 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9234ba5-0cc0-46dd-9ae3-a985159ea2a6 tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_341ddf1e-6211-421f-93dd-c1b4599e2085 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9234ba5-0cc0-46dd-9ae3-a985159ea2a6 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e@s_341ddf1e-6211-421f-93dd-c1b4599e2085', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_341ddf1e-6211-421f-93dd-c1b4599e2085', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443555', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '266240', 'sharesmb': None, 'createtxg': '113544', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1274103874509702164', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '921bf8693c78250b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265300992', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '7.80', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '86795', 'name': 's_341ddf1e-6211-421f-93dd-c1b4599e2085', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_341ddf1e-6211-421f-93dd-c1b4599e2085 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9234ba5-0cc0-46dd-9ae3-a985159ea2a6 tempest-SnapshotDataIntegrityTests-450991924 None] delete snapshot s_341ddf1e-6211-421f-93dd-c1b4599e2085 of volume v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:20:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9234ba5-0cc0-46dd-9ae3-a985159ea2a6 tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots/s_341ddf1e-6211-421f-93dd-c1b4599e2085 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9234ba5-0cc0-46dd-9ae3-a985159ea2a6 tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots/s_341ddf1e-6211-421f-93dd-c1b4599e2085 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:17 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:20:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Flow 'volume_create_manager' (c472da83-34db-4b11-a4da-f23b0baa4ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:20:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9febac03-7459-48f7-b4bd-a1cc9f52a8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:20:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9febac03-7459-48f7-b4bd-a1cc9f52a8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-656303765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b689b65111045168cf21c51bf1274f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:20:18Z,use_quota=True,user_id='c1390cde350341c3ac0275e429146cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:20:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6043c38a-ceaf-4bdd-961e-36e722f46b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:20:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6043c38a-ceaf-4bdd-961e-36e722f46b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:20:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab62522-9c96-4061-90c0-d03f2c03072b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:20:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab62522-9c96-4061-90c0-d03f2c03072b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36', 'volume_name': 'volume-c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:20:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb94872-ccef-4b14-acd7-2d30a87a10b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:20:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb94872-ccef-4b14-acd7-2d30a87a10b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:20:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62cfc5c-9210-4989-a77c-d675796b0bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:20:17 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Volume c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36', 'volume_size': 1} Apr 14 03:20:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] creating volume v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:20:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] create volume {'name': 'v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:20:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9234ba5-0cc0-46dd-9ae3-a985159ea2a6 tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots/s_341ddf1e-6211-421f-93dd-c1b4599e2085 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9234ba5-0cc0-46dd-9ae3-a985159ea2a6 tempest-SnapshotDataIntegrityTests-450991924 None] snapshot s_341ddf1e-6211-421f-93dd-c1b4599e2085 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:20:17 user cinder-volume[73403]: DEBUG cinder.quota [None req-d9234ba5-0cc0-46dd-9ae3-a985159ea2a6 tempest-SnapshotDataIntegrityTests-450991924 None] Created reservations ['1ee56220-17e5-4a08-91e9-6a855f160383', 'f8e9b064-5b50-4d61-b535-c21d8a4ea21e', '8a971aea-1733-4185-ac5a-ac149b19d924', 'dfdec2cd-9721-4fa8-a2db-cc3b69306dfc'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:20:17 user cinder-volume[73403]: INFO cinder.volume.manager [None req-d9234ba5-0cc0-46dd-9ae3-a985159ea2a6 tempest-SnapshotDataIntegrityTests-450991924 None] Delete snapshot completed successfully. Apr 14 03:20:17 user cinder-volume[73403]: DEBUG cinder.coordination [None req-d9234ba5-0cc0-46dd-9ae3-a985159ea2a6 tempest-SnapshotDataIntegrityTests-450991924 None] Lock "cinder-341ddf1e-6211-421f-93dd-c1b4599e2085-delete_snapshot" released by "delete_snapshot" :: held 2.638s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:20:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36', 'is_clone': False, 'name': 'v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62cfc5c-9210-4989-a77c-d675796b0bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:20:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00105a5e-249c-4c3a-b321-9d7076a992bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:20:18 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Volume volume-c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 (c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36): created successfully Apr 14 03:20:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00105a5e-249c-4c3a-b321-9d7076a992bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:20:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Flow 'volume_create_manager' (c472da83-34db-4b11-a4da-f23b0baa4ded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:20:18 user cinder-volume[73403]: INFO cinder.volume.manager [None req-d8832f2e-a783-440a-8be9-694c952e1a6c tempest-AttachVolumeNegativeTest-376301777 None] Created volume successfully. Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.coordination [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Acquiring lock "cinder-d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.coordination [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Lock "cinder-d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=55,cinder:INSERT=6,cinder:UPDATE=37,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] remove_export for volume: d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1380512440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e,launched_at=2023-04-14T03:15:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0096d0892acf4d5f8a0fa290a18b451a',provider_auth='CHAP QsIZOXnq 42OF6rVHTysz8B',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:15:31Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:20:19Z,updated_at=2023-04-14T03:20:19Z,use_quota=True,user_id='ba8614e27c65428d92e4bf01969976e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] detach volume v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e from target iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/luns/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/luns/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/luns/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/luns/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] failed to remove resource iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e because of JDSS resource v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] delete target: iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] delete target iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] failed to remove resource iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e because of JDSS resource iqn.2010-10.org.openstack:d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] deleating volume v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] get snapshots for volume v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] get volume v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443540', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '475136', 'sharesmb': None, 'createtxg': '113498', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7051981639678090116', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '475136', 'logicalused': '1892352', 'compressratio': '4.52', 'rootcontext': 'none', 'default_scsi_id': 'df67d5a7d8ca4764', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265489408', 'san:volume_id': 'df67d5a7d8ca476447c37e20b2366b3714225785', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.52', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '475136', 'objsetid': '85757', 'name': 'v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '475136', 'logicalreferenced': '1892352', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] delete volume:v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] create export for volume: c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:20:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] ensure volume c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:20:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] check if targe iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:20:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] create target and attach volume c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:20:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] create target iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:20:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] volume v_d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:20:21 user cinder-volume[73403]: DEBUG cinder.quota [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Created reservations ['602d4c3a-0943-476e-a656-27de00468ca0', '1a08dba8-a063-43c2-a831-bd01cf555e9a', '2f1a79b2-b198-428f-934b-550572fc61f9', 'bd7c79bf-8649-4301-90ff-ef68e70f45e9'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:20:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:20:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:20:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Geting {'code': 200, 'error': None, 'data': {'available': '114266025984', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:20:22 user cinder-volume[73403]: DEBUG cinder.manager [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:20:22 user cinder-volume[73403]: INFO cinder.volume.manager [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Deleted volume successfully. Apr 14 03:20:22 user cinder-volume[73403]: DEBUG cinder.coordination [None req-def79f86-f67e-438b-9309-bea51ead2cad tempest-SnapshotDataIntegrityTests-450991924 None] Lock "cinder-d51ab0f1-4bb3-4e37-bb8e-8c3199935e9e-delete_volume" released by "delete_volume" :: held 3.093s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:20:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] atach volume v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 to target iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:20:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3164613665323061', 'lun': 0, 'mode': 'wt', 'name': 'v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36', 'prod_id': 'Storage', 'scsi_id': '1da6e20ad5d00e5e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] add credentails to target iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:20:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 201, 'error': None, 'data': {'name': 'YIukGbUA'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] initialize_connection for c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:20:24 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIukGbUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'b2efd92e-831d-4fa4-b5ef-ca0092a85ed6'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:20:25 user cinder-volume[73403]: INFO cinder.volume.manager [req-04a612b3-d249-41fa-8f92-f4b1c2794400 req-79932fcd-9d82-471a-9b99-5ebfcf3d5bdd tempest-AttachVolumeNegativeTest-376301777 None] attachment_update completed successfully. Apr 14 03:20:52 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=49,cinder:INSERT=5,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:52 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=25,cinder:INSERT=4,cinder:UPDATE=11 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:20:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2db03106-21d6-4b86-959b-e99df1516856 req-4ffb7b20-7446-4c75-9bff-ce029185a572 tempest-ServerActionsTestJSON-1848627478 None] terminate connection for 7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:20:55 user cinder-volume[73403]: INFO cinder.volume.manager [req-2db03106-21d6-4b86-959b-e99df1516856 req-4ffb7b20-7446-4c75-9bff-ce029185a572 tempest-ServerActionsTestJSON-1848627478 None] Terminate volume connection completed successfully. Apr 14 03:20:55 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-2db03106-21d6-4b86-959b-e99df1516856 req-4ffb7b20-7446-4c75-9bff-ce029185a572 tempest-ServerActionsTestJSON-1848627478 None] Deleting attachment 43ac2eb3-9113-4367-a91a-8cd526f86d35. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:20:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2db03106-21d6-4b86-959b-e99df1516856 req-4ffb7b20-7446-4c75-9bff-ce029185a572 tempest-ServerActionsTestJSON-1848627478 None] remove_export for volume: 7378e388-0e78-4212-b0ce-a1e082ba31ab. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:20:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2db03106-21d6-4b86-959b-e99df1516856 req-4ffb7b20-7446-4c75-9bff-ce029185a572 tempest-ServerActionsTestJSON-1848627478 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:20:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2db03106-21d6-4b86-959b-e99df1516856 req-4ffb7b20-7446-4c75-9bff-ce029185a572 tempest-ServerActionsTestJSON-1848627478 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1077479502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7378e388-0e78-4212-b0ce-a1e082ba31ab,launched_at=2023-04-14T03:14:17Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='4075885e26cb4adaad24d3ae6217fe35',provider_auth='CHAP tUxPOhHN Gu7Z2kmnVyRwaX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:14:15Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:16:30Z,use_quota=True,user_id='7dea23743ba945c4a9d539b8e277c653',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:20:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2db03106-21d6-4b86-959b-e99df1516856 req-4ffb7b20-7446-4c75-9bff-ce029185a572 tempest-ServerActionsTestJSON-1848627478 None] detach volume v_7378e388-0e78-4212-b0ce-a1e082ba31ab from target iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:20:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-4ffb7b20-7446-4c75-9bff-ce029185a572 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/luns/v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-4ffb7b20-7446-4c75-9bff-ce029185a572 tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/luns/v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-4ffb7b20-7446-4c75-9bff-ce029185a572 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/luns/v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2db03106-21d6-4b86-959b-e99df1516856 req-4ffb7b20-7446-4c75-9bff-ce029185a572 tempest-ServerActionsTestJSON-1848627478 None] delete target: iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2db03106-21d6-4b86-959b-e99df1516856 req-4ffb7b20-7446-4c75-9bff-ce029185a572 tempest-ServerActionsTestJSON-1848627478 None] delete target iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-4ffb7b20-7446-4c75-9bff-ce029185a572 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-4ffb7b20-7446-4c75-9bff-ce029185a572 tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-4ffb7b20-7446-4c75-9bff-ce029185a572 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2db03106-21d6-4b86-959b-e99df1516856 req-4ffb7b20-7446-4c75-9bff-ce029185a572 tempest-ServerActionsTestJSON-1848627478 None] target iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.coordination [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Acquiring lock "cinder-7378e388-0e78-4212-b0ce-a1e082ba31ab-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.coordination [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Lock "cinder-7378e388-0e78-4212-b0ce-a1e082ba31ab-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] remove_export for volume: 7378e388-0e78-4212-b0ce-a1e082ba31ab. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1077479502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7378e388-0e78-4212-b0ce-a1e082ba31ab,launched_at=2023-04-14T03:14:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4075885e26cb4adaad24d3ae6217fe35',provider_auth='CHAP tUxPOhHN Gu7Z2kmnVyRwaX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:14:15Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:20:57Z,updated_at=2023-04-14T03:20:57Z,use_quota=True,user_id='7dea23743ba945c4a9d539b8e277c653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] detach volume v_7378e388-0e78-4212-b0ce-a1e082ba31ab from target iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/luns/v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/luns/v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/luns/v_7378e388-0e78-4212-b0ce-a1e082ba31ab'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab/luns/v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] failed to remove resource iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab because of JDSS resource v_7378e388-0e78-4212-b0ce-a1e082ba31ab DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] delete target: iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] delete target iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] failed to remove resource iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab because of JDSS resource iqn.2010-10.org.openstack:7378e388-0e78-4212-b0ce-a1e082ba31ab DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] deleating volume v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] get snapshots for volume v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7378e388-0e78-4212-b0ce-a1e082ba31ab/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7378e388-0e78-4212-b0ce-a1e082ba31ab/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7378e388-0e78-4212-b0ce-a1e082ba31ab/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] get volume v_7378e388-0e78-4212-b0ce-a1e082ba31ab info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:20:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_7378e388-0e78-4212-b0ce-a1e082ba31ab', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7378e388-0e78-4212-b0ce-a1e082ba31ab', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443465', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26107904', 'sharesmb': None, 'createtxg': '113430', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2276685035180601728', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10129408', 'logicalused': '26030080', 'compressratio': '2.58', 'rootcontext': 'none', 'default_scsi_id': '01879db36f93b921', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265997312', 'san:volume_id': '01879db36f93b921789360ad2aca07e8ca6668c7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10129408', 'objsetid': '84734', 'name': 'v_7378e388-0e78-4212-b0ce-a1e082ba31ab', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10129408', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] delete snapshot v_7378e388-0e78-4212-b0ce-a1e082ba31ab of volume v_482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:20:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_7378e388-0e78-4212-b0ce-a1e082ba31ab {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] snapshot v_7378e388-0e78-4212-b0ce-a1e082ba31ab deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:20:58 user cinder-volume[73403]: DEBUG cinder.quota [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Created reservations ['cc92462c-5a11-496f-bb3b-5c3f73fdfa33', '5b7b4dec-4c05-4db3-80e1-45e68a720908', '3c53f2e7-0357-4577-b6a7-377a5edc2b30', '59b8b898-dd7f-4494-adfb-17df3b0d1c2d'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:20:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:20:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:20:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:20:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:20:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276249600', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:20:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:20:59 user cinder-volume[73403]: DEBUG cinder.manager [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:20:59 user cinder-volume[73403]: INFO cinder.volume.manager [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Deleted volume successfully. Apr 14 03:20:59 user cinder-volume[73403]: DEBUG cinder.coordination [req-2db03106-21d6-4b86-959b-e99df1516856 req-e3ac1503-e77b-4094-881e-ee63472c11ac tempest-ServerActionsTestJSON-1848627478 None] Lock "cinder-7378e388-0e78-4212-b0ce-a1e082ba31ab-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:21:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:21:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:21:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:21:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:21:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:21:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276249600', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:21:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:21:03 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:21:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=15,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:21:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=17,cinder:UPDATE=11,cinder:INSERT=3,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:21:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:21:52 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:21:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6367bc65-9309-419f-a4a6-f21d79243a8c req-4aaed1c3-193e-4ed0-9e04-89c4e37709de tempest-TestMinimumBasicScenario-144187586 None] terminate connection for 96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:21:52 user cinder-volume[73403]: INFO cinder.volume.manager [req-6367bc65-9309-419f-a4a6-f21d79243a8c req-4aaed1c3-193e-4ed0-9e04-89c4e37709de tempest-TestMinimumBasicScenario-144187586 None] Terminate volume connection completed successfully. Apr 14 03:21:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-6367bc65-9309-419f-a4a6-f21d79243a8c req-4aaed1c3-193e-4ed0-9e04-89c4e37709de tempest-TestMinimumBasicScenario-144187586 None] Deleting attachment bca5b8c8-48bf-4f16-a19b-3e953f04cdc1. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:21:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6367bc65-9309-419f-a4a6-f21d79243a8c req-4aaed1c3-193e-4ed0-9e04-89c4e37709de tempest-TestMinimumBasicScenario-144187586 None] remove_export for volume: 96f437f9-4897-417a-95e3-097d2ff29476. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:21:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6367bc65-9309-419f-a4a6-f21d79243a8c req-4aaed1c3-193e-4ed0-9e04-89c4e37709de tempest-TestMinimumBasicScenario-144187586 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:21:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6367bc65-9309-419f-a4a6-f21d79243a8c req-4aaed1c3-193e-4ed0-9e04-89c4e37709de tempest-TestMinimumBasicScenario-144187586 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1364144328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=96f437f9-4897-417a-95e3-097d2ff29476,launched_at=2023-04-14T03:19:40Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0bd451b3f6734fe3ac0a8e8a853bb9eb',provider_auth='CHAP JTPOdpZX Cn24cJej0AoaPW',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:19:39Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:21:51Z,use_quota=True,user_id='12199a43298942898a2e694ee2c5230e',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:21:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6367bc65-9309-419f-a4a6-f21d79243a8c req-4aaed1c3-193e-4ed0-9e04-89c4e37709de tempest-TestMinimumBasicScenario-144187586 None] detach volume v_96f437f9-4897-417a-95e3-097d2ff29476 from target iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:21:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6367bc65-9309-419f-a4a6-f21d79243a8c req-4aaed1c3-193e-4ed0-9e04-89c4e37709de tempest-TestMinimumBasicScenario-144187586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476/luns/v_96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:21:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6367bc65-9309-419f-a4a6-f21d79243a8c req-4aaed1c3-193e-4ed0-9e04-89c4e37709de tempest-TestMinimumBasicScenario-144187586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476/luns/v_96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:21:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6367bc65-9309-419f-a4a6-f21d79243a8c req-4aaed1c3-193e-4ed0-9e04-89c4e37709de tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476/luns/v_96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:21:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6367bc65-9309-419f-a4a6-f21d79243a8c req-4aaed1c3-193e-4ed0-9e04-89c4e37709de tempest-TestMinimumBasicScenario-144187586 None] delete target: iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:21:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6367bc65-9309-419f-a4a6-f21d79243a8c req-4aaed1c3-193e-4ed0-9e04-89c4e37709de tempest-TestMinimumBasicScenario-144187586 None] delete target iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:21:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6367bc65-9309-419f-a4a6-f21d79243a8c req-4aaed1c3-193e-4ed0-9e04-89c4e37709de tempest-TestMinimumBasicScenario-144187586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:21:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6367bc65-9309-419f-a4a6-f21d79243a8c req-4aaed1c3-193e-4ed0-9e04-89c4e37709de tempest-TestMinimumBasicScenario-144187586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:21:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6367bc65-9309-419f-a4a6-f21d79243a8c req-4aaed1c3-193e-4ed0-9e04-89c4e37709de tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:21:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6367bc65-9309-419f-a4a6-f21d79243a8c req-4aaed1c3-193e-4ed0-9e04-89c4e37709de tempest-TestMinimumBasicScenario-144187586 None] target iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:22:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:22:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:22:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:22:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276237312', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:22:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:22:04 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=1,cinder:SELECT=8 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-05ff6a12-c479-4fce-8eb3-4426456f4eef req-cd29181f-f0f0-49c0-8a6a-8d1f6ab90a68 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] terminate connection for 46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:22:04 user cinder-volume[73403]: INFO cinder.volume.manager [req-05ff6a12-c479-4fce-8eb3-4426456f4eef req-cd29181f-f0f0-49c0-8a6a-8d1f6ab90a68 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Terminate volume connection completed successfully. Apr 14 03:22:04 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-05ff6a12-c479-4fce-8eb3-4426456f4eef req-cd29181f-f0f0-49c0-8a6a-8d1f6ab90a68 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Deleting attachment a5bbbb1b-897b-41af-817a-9723fbeb8547. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:22:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-05ff6a12-c479-4fce-8eb3-4426456f4eef req-cd29181f-f0f0-49c0-8a6a-8d1f6ab90a68 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] remove_export for volume: 46511b99-537b-43ba-af8f-65b70b89170b. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:22:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-05ff6a12-c479-4fce-8eb3-4426456f4eef req-cd29181f-f0f0-49c0-8a6a-8d1f6ab90a68 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:22:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-05ff6a12-c479-4fce-8eb3-4426456f4eef req-cd29181f-f0f0-49c0-8a6a-8d1f6ab90a68 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:16:31Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=46511b99-537b-43ba-af8f-65b70b89170b,launched_at=2023-04-14T03:16:34Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='bd2c5b2aafaf4ca7bf62e988ac726658',provider_auth='CHAP cwEYTBpt DAeczrFUW1aOR5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:16:31Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:16:42Z,use_quota=True,user_id='d666936eb0ee43a2ad9e17a12e6e273d',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:22:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-05ff6a12-c479-4fce-8eb3-4426456f4eef req-cd29181f-f0f0-49c0-8a6a-8d1f6ab90a68 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] detach volume v_46511b99-537b-43ba-af8f-65b70b89170b from target iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:22:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-05ff6a12-c479-4fce-8eb3-4426456f4eef req-cd29181f-f0f0-49c0-8a6a-8d1f6ab90a68 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b/luns/v_46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-05ff6a12-c479-4fce-8eb3-4426456f4eef req-cd29181f-f0f0-49c0-8a6a-8d1f6ab90a68 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b/luns/v_46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-05ff6a12-c479-4fce-8eb3-4426456f4eef req-cd29181f-f0f0-49c0-8a6a-8d1f6ab90a68 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b/luns/v_46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-05ff6a12-c479-4fce-8eb3-4426456f4eef req-cd29181f-f0f0-49c0-8a6a-8d1f6ab90a68 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] delete target: iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:22:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-05ff6a12-c479-4fce-8eb3-4426456f4eef req-cd29181f-f0f0-49c0-8a6a-8d1f6ab90a68 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] delete target iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:22:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-05ff6a12-c479-4fce-8eb3-4426456f4eef req-cd29181f-f0f0-49c0-8a6a-8d1f6ab90a68 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-05ff6a12-c479-4fce-8eb3-4426456f4eef req-cd29181f-f0f0-49c0-8a6a-8d1f6ab90a68 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-05ff6a12-c479-4fce-8eb3-4426456f4eef req-cd29181f-f0f0-49c0-8a6a-8d1f6ab90a68 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:05 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-05ff6a12-c479-4fce-8eb3-4426456f4eef req-cd29181f-f0f0-49c0-8a6a-8d1f6ab90a68 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] target iqn.2010-10.org.openstack:46511b99-537b-43ba-af8f-65b70b89170b deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:22:22 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:34 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Acquiring lock "cinder-44f3cbc9-fd81-4185-aa74-0896739af983-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:22:34 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Lock "cinder-44f3cbc9-fd81-4185-aa74-0896739af983-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:22:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] remove_export for volume: 44f3cbc9-fd81-4185-aa74-0896739af983. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:22:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:22:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-368917324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=44f3cbc9-fd81-4185-aa74-0896739af983,launched_at=2023-04-14T03:06:39Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4075885e26cb4adaad24d3ae6217fe35',provider_auth='CHAP rCsYcqle dmt65IHyECkAD0',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:06:38Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:22:35Z,updated_at=2023-04-14T03:22:35Z,use_quota=True,user_id='7dea23743ba945c4a9d539b8e277c653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:22:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] detach volume v_44f3cbc9-fd81-4185-aa74-0896739af983 from target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:22:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns/v_44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns/v_44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns/v_44f3cbc9-fd81-4185-aa74-0896739af983'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983/luns/v_44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] failed to remove resource iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 because of JDSS resource v_44f3cbc9-fd81-4185-aa74-0896739af983 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:22:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] delete target: iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:22:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] delete target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:22:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] failed to remove resource iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 because of JDSS resource iqn.2010-10.org.openstack:44f3cbc9-fd81-4185-aa74-0896739af983 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:22:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] deleating volume v_44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:22:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] get snapshots for volume v_44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:22:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_44f3cbc9-fd81-4185-aa74-0896739af983/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_44f3cbc9-fd81-4185-aa74-0896739af983/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_44f3cbc9-fd81-4185-aa74-0896739af983/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] get volume v_44f3cbc9-fd81-4185-aa74-0896739af983 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:22:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_44f3cbc9-fd81-4185-aa74-0896739af983', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443008', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113022', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1745073921329716976', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'eb5c4eba774e2823', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276249600', 'san:volume_id': 'eb5c4eba774e2823e773a7d8d9691cde1370268a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86146', 'name': 'v_44f3cbc9-fd81-4185-aa74-0896739af983', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] delete volume:v_44f3cbc9-fd81-4185-aa74-0896739af983 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:22:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_44f3cbc9-fd81-4185-aa74-0896739af983 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] volume v_44f3cbc9-fd81-4185-aa74-0896739af983 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:22:37 user cinder-volume[73403]: DEBUG cinder.quota [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Created reservations ['a16be890-8fbc-42b9-b228-c57721d62343', '7618b265-7eb2-4ea3-a9d8-c107c4eb30c4', '281f17f9-959d-4c14-ab42-1217bb7d6020', '7da60472-0d21-49ad-af1a-8b42a25f14c1'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:22:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:22:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:22:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276331520', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:22:37 user cinder-volume[73403]: DEBUG cinder.manager [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:22:37 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Deleted volume successfully. Apr 14 03:22:37 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a6e26051-9e6f-453f-b8d7-1088966dfc87 tempest-ServerActionsTestJSON-1848627478 None] Lock "cinder-44f3cbc9-fd81-4185-aa74-0896739af983-delete_volume" released by "delete_volume" :: held 3.024s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Acquiring lock "cinder-f0c626e1-cd60-46d3-b894-a000a5cb3811-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Lock "cinder-f0c626e1-cd60-46d3-b894-a000a5cb3811-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] remove_export for volume: f0c626e1-cd60-46d3-b894-a000a5cb3811. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-324770688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f0c626e1-cd60-46d3-b894-a000a5cb3811,launched_at=2023-04-14T03:01:44Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4075885e26cb4adaad24d3ae6217fe35',provider_auth='CHAP cpDvVdUM bkHZ1xmYjIoWs5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:01:43Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:22:38Z,updated_at=2023-04-14T03:22:38Z,use_quota=True,user_id='7dea23743ba945c4a9d539b8e277c653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] detach volume v_f0c626e1-cd60-46d3-b894-a000a5cb3811 from target iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/luns/v_f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/luns/v_f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/luns/v_f0c626e1-cd60-46d3-b894-a000a5cb3811'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811/luns/v_f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] failed to remove resource iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 because of JDSS resource v_f0c626e1-cd60-46d3-b894-a000a5cb3811 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] delete target: iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] delete target iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] failed to remove resource iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 because of JDSS resource iqn.2010-10.org.openstack:f0c626e1-cd60-46d3-b894-a000a5cb3811 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] deleating volume v_f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] get snapshots for volume v_f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f0c626e1-cd60-46d3-b894-a000a5cb3811/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f0c626e1-cd60-46d3-b894-a000a5cb3811/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f0c626e1-cd60-46d3-b894-a000a5cb3811/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] get volume v_f0c626e1-cd60-46d3-b894-a000a5cb3811 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f0c626e1-cd60-46d3-b894-a000a5cb3811', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681442712', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '112802', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11290299734870799566', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c679e70b664dba58', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276331520', 'san:volume_id': 'c679e70b664dba585cb06875289c0bf510ae2478', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85080', 'name': 'v_f0c626e1-cd60-46d3-b894-a000a5cb3811', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] delete volume:v_f0c626e1-cd60-46d3-b894-a000a5cb3811 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f0c626e1-cd60-46d3-b894-a000a5cb3811 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] volume v_f0c626e1-cd60-46d3-b894-a000a5cb3811 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:22:40 user cinder-volume[73403]: DEBUG cinder.quota [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Created reservations ['22db8d90-c406-45ee-b2b0-01fb3392fb82', 'b29ebc7a-51ad-4d5d-8294-5b47bb365153', 'a1a62b67-fdd3-4e2c-8f1a-32de73a6c93e', '967c7767-4fde-4946-b5ae-b26fd4910ff3'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:22:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:22:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:22:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276425728', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.manager [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:22:41 user cinder-volume[73403]: INFO cinder.volume.manager [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Deleted volume successfully. Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b77a9331-89c8-4e0d-bd3b-7e01bdf318f1 tempest-ServerActionsTestJSON-1848627478 None] Lock "cinder-f0c626e1-cd60-46d3-b894-a000a5cb3811-delete_volume" released by "delete_volume" :: held 2.956s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Acquiring lock "cinder-96f437f9-4897-417a-95e3-097d2ff29476-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Lock "cinder-96f437f9-4897-417a-95e3-097d2ff29476-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] remove_export for volume: 96f437f9-4897-417a-95e3-097d2ff29476. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1364144328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=96f437f9-4897-417a-95e3-097d2ff29476,launched_at=2023-04-14T03:19:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd451b3f6734fe3ac0a8e8a853bb9eb',provider_auth='CHAP JTPOdpZX Cn24cJej0AoaPW',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:19:39Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:22:42Z,updated_at=2023-04-14T03:22:42Z,use_quota=True,user_id='12199a43298942898a2e694ee2c5230e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] detach volume v_96f437f9-4897-417a-95e3-097d2ff29476 from target iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476/luns/v_96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476/luns/v_96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476/luns/v_96f437f9-4897-417a-95e3-097d2ff29476'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476/luns/v_96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] failed to remove resource iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 because of JDSS resource v_96f437f9-4897-417a-95e3-097d2ff29476 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] delete target: iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] delete target iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] failed to remove resource iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 because of JDSS resource iqn.2010-10.org.openstack:96f437f9-4897-417a-95e3-097d2ff29476 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] deleating volume v_96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] get snapshots for volume v_96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96f437f9-4897-417a-95e3-097d2ff29476/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96f437f9-4897-417a-95e3-097d2ff29476/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96f437f9-4897-417a-95e3-097d2ff29476/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] get volume v_96f437f9-4897-417a-95e3-097d2ff29476 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:22:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_96f437f9-4897-417a-95e3-097d2ff29476', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443788', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113801', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6727453182896003021', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '77ba4048fe052f03', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276425728', 'san:volume_id': '77ba4048fe052f039bc5f7446e4313125f970e2b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86747', 'name': 'v_96f437f9-4897-417a-95e3-097d2ff29476', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] delete volume:v_96f437f9-4897-417a-95e3-097d2ff29476 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:22:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_96f437f9-4897-417a-95e3-097d2ff29476 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] volume v_96f437f9-4897-417a-95e3-097d2ff29476 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:22:43 user cinder-volume[73403]: DEBUG cinder.quota [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Created reservations ['242d631b-dd57-4d17-83f3-b1b9ebc77b3d', '9204a2c5-ef7a-4fb5-8fa9-6c02f03c6924', '1f46889c-4cd7-4969-9f3e-150c03ff256d', 'c8018824-88f7-4271-9af3-ccde1a9817a1'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:22:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:22:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:22:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276532224', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:22:44 user cinder-volume[73403]: DEBUG cinder.manager [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:22:44 user cinder-volume[73403]: INFO cinder.volume.manager [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Deleted volume successfully. Apr 14 03:22:44 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e7e45334-ba30-4d53-94c7-f2fb90a5b92e tempest-TestMinimumBasicScenario-144187586 None] Lock "cinder-96f437f9-4897-417a-95e3-097d2ff29476-delete_volume" released by "delete_volume" :: held 3.090s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:22:52 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=35,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:22:56 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:22:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Flow 'volume_create_manager' (8628d386-5034-4171-bbd8-8c2ae386f249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:22:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cca81c5-a486-4f9c-8501-09f2d8a069c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:22:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cca81c5-a486-4f9c-8501-09f2d8a069c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-41901388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e5f4ba93-96de-4c67-a1b5-de6c2b589b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22119efd6fd0428bbf9fc4d9a4ebc0b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:22:57Z,use_quota=True,user_id='90f11e1ad5e2438788c031b0a3e297b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:22:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe08241-860d-4099-8656-c53af6b7feb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:22:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe08241-860d-4099-8656-c53af6b7feb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:22:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65203684-5e00-4cb0-b0c3-e0cd33bdea50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:22:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65203684-5e00-4cb0-b0c3-e0cd33bdea50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5f4ba93-96de-4c67-a1b5-de6c2b589b03', 'volume_name': 'volume-e5f4ba93-96de-4c67-a1b5-de6c2b589b03', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:22:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08488a4b-b523-4150-804a-856af2d01982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:22:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08488a4b-b523-4150-804a-856af2d01982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:22:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4f1bb6-d048-44ed-894d-c33af2b39030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:22:56 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Volume e5f4ba93-96de-4c67-a1b5-de6c2b589b03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5f4ba93-96de-4c67-a1b5-de6c2b589b03', 'volume_size': 1} Apr 14 03:22:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] creating volume v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:22:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] create volume {'name': 'v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:22:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03', 'is_clone': False, 'name': 'v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4f1bb6-d048-44ed-894d-c33af2b39030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5f4ba93-96de-4c67-a1b5-de6c2b589b03', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:22:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b042b59a-cf52-4449-bbb5-a1e3f7a1f760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:22:57 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Volume volume-e5f4ba93-96de-4c67-a1b5-de6c2b589b03 (e5f4ba93-96de-4c67-a1b5-de6c2b589b03): created successfully Apr 14 03:22:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b042b59a-cf52-4449-bbb5-a1e3f7a1f760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:22:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Flow 'volume_create_manager' (8628d386-5034-4171-bbd8-8c2ae386f249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:22:57 user cinder-volume[73403]: INFO cinder.volume.manager [None req-9e935cef-3999-4a78-82c7-6ff5f6ee4cdd tempest-VolumesMetadataTest-2064412607 None] Created volume successfully. Apr 14 03:22:59 user cinder-volume[73403]: DEBUG cinder.coordination [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Acquiring lock "cinder-e5f4ba93-96de-4c67-a1b5-de6c2b589b03-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:22:59 user cinder-volume[73403]: DEBUG cinder.coordination [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Lock "cinder-e5f4ba93-96de-4c67-a1b5-de6c2b589b03-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:22:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] remove_export for volume: e5f4ba93-96de-4c67-a1b5-de6c2b589b03. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:22:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:22:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-41901388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e5f4ba93-96de-4c67-a1b5-de6c2b589b03,launched_at=2023-04-14T03:22:58Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22119efd6fd0428bbf9fc4d9a4ebc0b6',provider_auth='CHAP QTYXuRhv 5q6Q8SKFYML4hT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4ba93-96de-4c67-a1b5-de6c2b589b03 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:22:57Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:22:59Z,updated_at=2023-04-14T03:22:59Z,use_quota=True,user_id='90f11e1ad5e2438788c031b0a3e297b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:e5f4ba93-96de-4c67-a1b5-de6c2b589b03. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:22:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] detach volume v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03 from target iqn.2010-10.org.openstack:e5f4ba93-96de-4c67-a1b5-de6c2b589b03 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:22:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e5f4ba93-96de-4c67-a1b5-de6c2b589b03/luns/v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e5f4ba93-96de-4c67-a1b5-de6c2b589b03/luns/v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e5f4ba93-96de-4c67-a1b5-de6c2b589b03 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e5f4ba93-96de-4c67-a1b5-de6c2b589b03/luns/v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e5f4ba93-96de-4c67-a1b5-de6c2b589b03/luns/v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] failed to remove resource iqn.2010-10.org.openstack:e5f4ba93-96de-4c67-a1b5-de6c2b589b03 because of JDSS resource v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:22:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] delete target: iqn.2010-10.org.openstack:e5f4ba93-96de-4c67-a1b5-de6c2b589b03 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:22:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] delete target iqn.2010-10.org.openstack:e5f4ba93-96de-4c67-a1b5-de6c2b589b03 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:22:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e5f4ba93-96de-4c67-a1b5-de6c2b589b03 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e5f4ba93-96de-4c67-a1b5-de6c2b589b03 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:22:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e5f4ba93-96de-4c67-a1b5-de6c2b589b03 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e5f4ba93-96de-4c67-a1b5-de6c2b589b03'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e5f4ba93-96de-4c67-a1b5-de6c2b589b03 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:22:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] failed to remove resource iqn.2010-10.org.openstack:e5f4ba93-96de-4c67-a1b5-de6c2b589b03 because of JDSS resource iqn.2010-10.org.openstack:e5f4ba93-96de-4c67-a1b5-de6c2b589b03 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:22:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] deleating volume v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:22:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] get snapshots for volume v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:22:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:22:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:23:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:23:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] get volume v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:23:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:23:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:23:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443986', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113892', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12914210385382282962', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '165f0d2707c1836a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276425728', 'san:volume_id': '165f0d2707c1836a540f7913be3a88f3a1e54cb9', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86204', 'name': 'v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:23:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] delete volume:v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:23:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:23:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:23:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:23:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] volume v_e5f4ba93-96de-4c67-a1b5-de6c2b589b03 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:23:01 user cinder-volume[73403]: DEBUG cinder.quota [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Created reservations ['a0058fa9-2db7-432c-984c-480a4390c54a', '330d4362-a030-4356-8b7a-3c42da0301b5', 'c73674b6-3573-43f6-a19a-05c4624d6d1e', '214179f4-a764-4726-9df7-e05502af0445'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:23:01 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=57,cinder:INSERT=9,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:23:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:23:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:23:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:23:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276519936', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:23:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:23:02 user cinder-volume[73403]: DEBUG cinder.manager [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:23:02 user cinder-volume[73403]: INFO cinder.volume.manager [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Deleted volume successfully. Apr 14 03:23:02 user cinder-volume[73403]: DEBUG cinder.coordination [None req-bcbbe4df-ac0e-4e83-b7b7-3a4dbd5df91f tempest-VolumesMetadataTest-2064412607 None] Lock "cinder-e5f4ba93-96de-4c67-a1b5-de6c2b589b03-delete_volume" released by "delete_volume" :: held 2.914s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:23:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:23:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:23:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:23:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:23:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:23:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276519936', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:23:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:23:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:23:06 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:23:06 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Flow 'volume_create_manager' (d51d05eb-31f5-4294-b72b-875dde59651d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:23:06 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3dadb1-19a7-40ae-a0b5-fa1a1b197397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:23:06 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3dadb1-19a7-40ae-a0b5-fa1a1b197397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-982252306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=13733823-bf33-4a1b-b8a0-3da8dadc58bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccb5ceb9f7641a9b6265de1f3c38c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:23:06Z,use_quota=True,user_id='85a2f927a9b94b6a8e9d91932bab0af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:23:06 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830bceff-8ce6-4e16-bcc4-8c0a71b79290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:23:06 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830bceff-8ce6-4e16-bcc4-8c0a71b79290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:23:06 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90099e30-b690-4997-a939-619ac6356b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:23:06 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90099e30-b690-4997-a939-619ac6356b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13733823-bf33-4a1b-b8a0-3da8dadc58bd', 'volume_name': 'volume-13733823-bf33-4a1b-b8a0-3da8dadc58bd', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:23:06 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f71ece-e023-45bc-9c81-49a4eaf72aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:23:06 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f71ece-e023-45bc-9c81-49a4eaf72aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:23:06 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fc36db-7975-4af1-97c8-427100ce4770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:23:06 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Volume 13733823-bf33-4a1b-b8a0-3da8dadc58bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13733823-bf33-4a1b-b8a0-3da8dadc58bd', 'volume_size': 1} Apr 14 03:23:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] creating volume v_13733823-bf33-4a1b-b8a0-3da8dadc58bd. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:23:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] create volume {'name': 'v_13733823-bf33-4a1b-b8a0-3da8dadc58bd', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:23:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:23:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:23:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_13733823-bf33-4a1b-b8a0-3da8dadc58bd', 'is_clone': False, 'name': 'v_13733823-bf33-4a1b-b8a0-3da8dadc58bd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:23:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fc36db-7975-4af1-97c8-427100ce4770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13733823-bf33-4a1b-b8a0-3da8dadc58bd', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:23:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4f500f-f287-4639-a3c5-6cc2ef868176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:23:07 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Volume volume-13733823-bf33-4a1b-b8a0-3da8dadc58bd (13733823-bf33-4a1b-b8a0-3da8dadc58bd): created successfully Apr 14 03:23:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4f500f-f287-4639-a3c5-6cc2ef868176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:23:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Flow 'volume_create_manager' (d51d05eb-31f5-4294-b72b-875dde59651d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:23:07 user cinder-volume[73403]: INFO cinder.volume.manager [None req-4249fbad-a69a-48a2-a1a6-f1c7ab7f3f68 tempest-VolumesNegativeTest-1844013062 None] Created volume successfully. Apr 14 03:23:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 req-78fd1c3e-e175-4a21-b131-e79865b5a5ba tempest-AttachVolumeNegativeTest-376301777 None] terminate connection for c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:23:14 user cinder-volume[73403]: INFO cinder.volume.manager [req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 req-78fd1c3e-e175-4a21-b131-e79865b5a5ba tempest-AttachVolumeNegativeTest-376301777 None] Terminate volume connection completed successfully. Apr 14 03:23:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 req-78fd1c3e-e175-4a21-b131-e79865b5a5ba tempest-AttachVolumeNegativeTest-376301777 None] Deleting attachment b2efd92e-831d-4fa4-b5ef-ca0092a85ed6. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:23:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 req-78fd1c3e-e175-4a21-b131-e79865b5a5ba tempest-AttachVolumeNegativeTest-376301777 None] remove_export for volume: c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:23:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 req-78fd1c3e-e175-4a21-b131-e79865b5a5ba tempest-AttachVolumeNegativeTest-376301777 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:23:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 req-78fd1c3e-e175-4a21-b131-e79865b5a5ba tempest-AttachVolumeNegativeTest-376301777 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-656303765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36,launched_at=2023-04-14T03:20:19Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='3b689b65111045168cf21c51bf1274f2',provider_auth='CHAP YIukGbUA SDA7qBrREfcxMy',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:20:18Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:23:13Z,use_quota=True,user_id='c1390cde350341c3ac0275e429146cf8',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:23:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 req-78fd1c3e-e175-4a21-b131-e79865b5a5ba tempest-AttachVolumeNegativeTest-376301777 None] detach volume v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 from target iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:23:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 req-78fd1c3e-e175-4a21-b131-e79865b5a5ba tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36/luns/v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:23:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 req-78fd1c3e-e175-4a21-b131-e79865b5a5ba tempest-AttachVolumeNegativeTest-376301777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36/luns/v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:23:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 req-78fd1c3e-e175-4a21-b131-e79865b5a5ba tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36/luns/v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:23:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 req-78fd1c3e-e175-4a21-b131-e79865b5a5ba tempest-AttachVolumeNegativeTest-376301777 None] delete target: iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:23:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 req-78fd1c3e-e175-4a21-b131-e79865b5a5ba tempest-AttachVolumeNegativeTest-376301777 None] delete target iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:23:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 req-78fd1c3e-e175-4a21-b131-e79865b5a5ba tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:23:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 req-78fd1c3e-e175-4a21-b131-e79865b5a5ba tempest-AttachVolumeNegativeTest-376301777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:23:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 req-78fd1c3e-e175-4a21-b131-e79865b5a5ba tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:23:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5a25cea7-36c8-46ee-81c5-2518d6d2cb35 req-78fd1c3e-e175-4a21-b131-e79865b5a5ba tempest-AttachVolumeNegativeTest-376301777 None] target iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:23:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=32,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=13,cinder:UPDATE=8 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:23:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a req-a10fe26e-dd30-4896-8d2c-ceccce15cf65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] terminate connection for 0af4cdb2-c179-4459-8ef7-43518caaaf7c {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:23:46 user cinder-volume[73403]: INFO cinder.volume.manager [req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a req-a10fe26e-dd30-4896-8d2c-ceccce15cf65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Terminate volume connection completed successfully. Apr 14 03:23:46 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a req-a10fe26e-dd30-4896-8d2c-ceccce15cf65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Deleting attachment 54363199-122c-4acb-8e4a-9a1e390c992e. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:23:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a req-a10fe26e-dd30-4896-8d2c-ceccce15cf65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] remove_export for volume: 0af4cdb2-c179-4459-8ef7-43518caaaf7c. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:23:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a req-a10fe26e-dd30-4896-8d2c-ceccce15cf65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:23:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a req-a10fe26e-dd30-4896-8d2c-ceccce15cf65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:07:59Z,deleted=False,deleted_at=None,display_description='',display_name='2692a422-82e6-4f3b-b91e-6a2ea28e4d0a-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0af4cdb2-c179-4459-8ef7-43518caaaf7c,launched_at=2023-04-14T03:08:00Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='bd2c5b2aafaf4ca7bf62e988ac726658',provider_auth='CHAP kMFlEcQj mpFHLgMsEw8RJu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:07:59Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:08:09Z,use_quota=True,user_id='d666936eb0ee43a2ad9e17a12e6e273d',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:23:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a req-a10fe26e-dd30-4896-8d2c-ceccce15cf65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] detach volume v_0af4cdb2-c179-4459-8ef7-43518caaaf7c from target iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:23:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a req-a10fe26e-dd30-4896-8d2c-ceccce15cf65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c/luns/v_0af4cdb2-c179-4459-8ef7-43518caaaf7c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:23:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a req-a10fe26e-dd30-4896-8d2c-ceccce15cf65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c/luns/v_0af4cdb2-c179-4459-8ef7-43518caaaf7c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:23:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a req-a10fe26e-dd30-4896-8d2c-ceccce15cf65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c/luns/v_0af4cdb2-c179-4459-8ef7-43518caaaf7c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:23:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a req-a10fe26e-dd30-4896-8d2c-ceccce15cf65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] delete target: iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:23:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a req-a10fe26e-dd30-4896-8d2c-ceccce15cf65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] delete target iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:23:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a req-a10fe26e-dd30-4896-8d2c-ceccce15cf65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:23:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a req-a10fe26e-dd30-4896-8d2c-ceccce15cf65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:23:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a req-a10fe26e-dd30-4896-8d2c-ceccce15cf65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:23:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-7d9db6a0-74eb-4c7e-9dc5-6048c003518a req-a10fe26e-dd30-4896-8d2c-ceccce15cf65 tempest-ServerBootFromVolumeStableRescueTest-1400694371 None] target iqn.2010-10.org.openstack:0af4cdb2-c179-4459-8ef7-43518caaaf7c deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:24:02 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:24:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:24:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:24:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:24:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:24:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276425728', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:24:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:24:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:24:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:24:52 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:25:02 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:25:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:25:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:25:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:25:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:25:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:25:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276438016', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:25:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:25:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:25:22 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:25:29 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:25:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Flow 'volume_create_manager' (e9aff7ec-ec61-4806-b6e4-4ce2ea301371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:25:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9da432b-57b0-4ccc-a082-bccfa2b2dd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:25:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9da432b-57b0-4ccc-a082-bccfa2b2dd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-609416730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd451b3f6734fe3ac0a8e8a853bb9eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:25:29Z,use_quota=True,user_id='12199a43298942898a2e694ee2c5230e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:25:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0046872f-a589-4943-94d2-27a00c19d798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:25:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0046872f-a589-4943-94d2-27a00c19d798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:25:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018c25ce-3d29-4164-bdfe-e3383c99c883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:25:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018c25ce-3d29-4164-bdfe-e3383c99c883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f', 'volume_name': 'volume-5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:25:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a702991e-f753-42bb-a768-df81d3ab0cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:25:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a702991e-f753-42bb-a768-df81d3ab0cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:25:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48fc05b-689f-4ce5-b2bf-7787d9917a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:25:29 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Volume 5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f', 'volume_size': 1} Apr 14 03:25:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] creating volume v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:25:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] create volume {'name': 'v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:25:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:25:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:25:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f', 'is_clone': False, 'name': 'v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:25:30 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48fc05b-689f-4ce5-b2bf-7787d9917a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:25:30 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb6d8fe4-7fce-4066-9fdf-0c47cedd8d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:25:30 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Volume volume-5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f (5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f): created successfully Apr 14 03:25:30 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb6d8fe4-7fce-4066-9fdf-0c47cedd8d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:25:30 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Flow 'volume_create_manager' (e9aff7ec-ec61-4806-b6e4-4ce2ea301371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:25:30 user cinder-volume[73403]: INFO cinder.volume.manager [None req-4af0d877-061c-4e80-93c7-ca3a151b21e3 tempest-TestMinimumBasicScenario-144187586 None] Created volume successfully. Apr 14 03:25:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] create export for volume: 5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:25:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] ensure volume 5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:25:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] check if targe iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:25:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:25:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:25:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:25:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] create target and attach volume 5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:25:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] create target iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:25:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:25:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:25:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:25:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:25:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] atach volume v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f to target iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:25:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:25:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:25:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6461326463616362', 'lun': 0, 'mode': 'wt', 'name': 'v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f', 'prod_id': 'Storage', 'scsi_id': 'da2dcacb4dcdd27f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:25:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] add credentails to target iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:25:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:25:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:25:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 201, 'error': None, 'data': {'name': 'riVmtpEC'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:25:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] initialize_connection for 5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:25:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'riVmtpEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '5abc96a7-2db7-4fbc-aa97-121b04fc25a5'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:25:36 user cinder-volume[73403]: INFO cinder.volume.manager [req-038a3209-0938-49e7-b4cd-ec37655b430a req-a61a118b-d33c-4047-8c0b-688871c6c89e tempest-TestMinimumBasicScenario-144187586 None] attachment_update completed successfully. Apr 14 03:25:52 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG cinder.coordination [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Acquiring lock "cinder-13733823-bf33-4a1b-b8a0-3da8dadc58bd-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG cinder.coordination [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Lock "cinder-13733823-bf33-4a1b-b8a0-3da8dadc58bd-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] remove_export for volume: 13733823-bf33-4a1b-b8a0-3da8dadc58bd. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-982252306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=13733823-bf33-4a1b-b8a0-3da8dadc58bd,launched_at=2023-04-14T03:23:07Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccb5ceb9f7641a9b6265de1f3c38c89',provider_auth='CHAP gSDHvndf ijpdbw2ZoHG7Qv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:13733823-bf33-4a1b-b8a0-3da8dadc58bd 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:23:06Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:25:56Z,updated_at=2023-04-14T03:25:56Z,use_quota=True,user_id='85a2f927a9b94b6a8e9d91932bab0af6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:13733823-bf33-4a1b-b8a0-3da8dadc58bd. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] detach volume v_13733823-bf33-4a1b-b8a0-3da8dadc58bd from target iqn.2010-10.org.openstack:13733823-bf33-4a1b-b8a0-3da8dadc58bd {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:13733823-bf33-4a1b-b8a0-3da8dadc58bd/luns/v_13733823-bf33-4a1b-b8a0-3da8dadc58bd {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:13733823-bf33-4a1b-b8a0-3da8dadc58bd/luns/v_13733823-bf33-4a1b-b8a0-3da8dadc58bd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:13733823-bf33-4a1b-b8a0-3da8dadc58bd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:13733823-bf33-4a1b-b8a0-3da8dadc58bd/luns/v_13733823-bf33-4a1b-b8a0-3da8dadc58bd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:13733823-bf33-4a1b-b8a0-3da8dadc58bd/luns/v_13733823-bf33-4a1b-b8a0-3da8dadc58bd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] failed to remove resource iqn.2010-10.org.openstack:13733823-bf33-4a1b-b8a0-3da8dadc58bd because of JDSS resource v_13733823-bf33-4a1b-b8a0-3da8dadc58bd DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] delete target: iqn.2010-10.org.openstack:13733823-bf33-4a1b-b8a0-3da8dadc58bd {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] delete target iqn.2010-10.org.openstack:13733823-bf33-4a1b-b8a0-3da8dadc58bd {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:13733823-bf33-4a1b-b8a0-3da8dadc58bd {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:13733823-bf33-4a1b-b8a0-3da8dadc58bd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:13733823-bf33-4a1b-b8a0-3da8dadc58bd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:13733823-bf33-4a1b-b8a0-3da8dadc58bd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:13733823-bf33-4a1b-b8a0-3da8dadc58bd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] failed to remove resource iqn.2010-10.org.openstack:13733823-bf33-4a1b-b8a0-3da8dadc58bd because of JDSS resource iqn.2010-10.org.openstack:13733823-bf33-4a1b-b8a0-3da8dadc58bd DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] deleating volume v_13733823-bf33-4a1b-b8a0-3da8dadc58bd {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] get snapshots for volume v_13733823-bf33-4a1b-b8a0-3da8dadc58bd {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_13733823-bf33-4a1b-b8a0-3da8dadc58bd/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:25:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_13733823-bf33-4a1b-b8a0-3da8dadc58bd/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:25:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_13733823-bf33-4a1b-b8a0-3da8dadc58bd/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:25:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] get volume v_13733823-bf33-4a1b-b8a0-3da8dadc58bd info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:25:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_13733823-bf33-4a1b-b8a0-3da8dadc58bd {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:25:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_13733823-bf33-4a1b-b8a0-3da8dadc58bd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:25:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_13733823-bf33-4a1b-b8a0-3da8dadc58bd', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443995', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113898', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2308248141491303583', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f15f16877c1c1b47', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276306944', 'san:volume_id': 'f15f16877c1c1b47dcd0284790da043f09c3b8ce', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86216', 'name': 'v_13733823-bf33-4a1b-b8a0-3da8dadc58bd', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_13733823-bf33-4a1b-b8a0-3da8dadc58bd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:25:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] delete volume:v_13733823-bf33-4a1b-b8a0-3da8dadc58bd recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:25:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_13733823-bf33-4a1b-b8a0-3da8dadc58bd {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:25:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_13733823-bf33-4a1b-b8a0-3da8dadc58bd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:25:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_13733823-bf33-4a1b-b8a0-3da8dadc58bd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:25:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] volume v_13733823-bf33-4a1b-b8a0-3da8dadc58bd deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:25:57 user cinder-volume[73403]: DEBUG cinder.quota [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Created reservations ['52ec3219-9519-43d5-94a4-35225df20633', '3ec591ba-65c8-48ff-8209-8691f8e36432', '0f925372-3a9e-43de-8aa2-fca24091c9aa', '08ef847a-3e70-4087-8992-a2969cdca98c'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:25:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:25:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:25:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:25:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:25:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276388864', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:25:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:25:58 user cinder-volume[73403]: DEBUG cinder.manager [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:25:58 user cinder-volume[73403]: INFO cinder.volume.manager [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Deleted volume successfully. Apr 14 03:25:58 user cinder-volume[73403]: DEBUG cinder.coordination [None req-312b652b-67fb-488f-8189-1eff036bce63 tempest-VolumesNegativeTest-1844013062 None] Lock "cinder-13733823-bf33-4a1b-b8a0-3da8dadc58bd-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:26:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:26:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:26:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:26:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:26:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:26:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276401152', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:26:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:26:03 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:26:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:15 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:26:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Flow 'volume_create_manager' (689682ed-cae1-45fb-befc-59381bbd8a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:26:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234cf9f1-e9f4-42ab-8ccf-50f9a21a9c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:26:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234cf9f1-e9f4-42ab-8ccf-50f9a21a9c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1037613746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3a8e1f1a-36b6-47b7-95f2-d31cd1b55808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e0979cf1834435bb0007899da52e863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:26:16Z,use_quota=True,user_id='61f477304a044148ade1c6acffd30712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:26:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18ab0de-7c46-4041-8676-76c1e579e115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:26:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18ab0de-7c46-4041-8676-76c1e579e115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:26:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (009868c4-0137-4216-b3cb-e05dda1129cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:26:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (009868c4-0137-4216-b3cb-e05dda1129cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3a8e1f1a-36b6-47b7-95f2-d31cd1b55808', 'volume_name': 'volume-3a8e1f1a-36b6-47b7-95f2-d31cd1b55808', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:26:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571c638f-3e04-46ce-84ac-610b1736f4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:26:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571c638f-3e04-46ce-84ac-610b1736f4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:26:15 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a372bc15-fbf8-4b66-906e-72f6c61aa1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:26:15 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Volume 3a8e1f1a-36b6-47b7-95f2-d31cd1b55808: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3a8e1f1a-36b6-47b7-95f2-d31cd1b55808', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 03:26:15 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Cloning 3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 from image 98e6a247-250b-4bb5-a947-e7f93598d16e at location (None, None). {{(pid=73403) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 03:26:15 user cinder-volume[73403]: DEBUG cinder.coordination [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Acquiring lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" by "_prepare_image_cache_entry" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:26:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:26:16 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 3, 26, 16, 7954)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 03:26:16 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 03:26:16 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Found cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 03:26:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Lock "cinder-98e6a247-250b-4bb5-a947-e7f93598d16e" released by "_prepare_image_cache_entry" :: held 0.013s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:26:16 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Attempting to retrieve cache entry for image = 98e6a247-250b-4bb5-a947-e7f93598d16e on host user@joviandss-2#joviandss-2. {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 03:26:16 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Found image-volume cache entry: {'id': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'volume_id': '482f938f-083c-4221-99f8-3320a80b8725', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13), 'last_used': datetime.datetime(2023, 4, 14, 3, 26, 16, 21768)}. {{(pid=73403) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 03:26:16 user cinder-volume[73403]: DEBUG cinder.image.cache [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Image-volume cache entry image_update_at = 2023-04-14 02:54:13+00:00, requested image updated_at = 2023-04-14 02:54:13+00:00. {{(pid=73403) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 03:26:16 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Creating from source image-volume 482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 03:26:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] cloned volume 482f938f-083c-4221-99f8-3320a80b8725 to 3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 03:26:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] cloning v_482f938f-083c-4221-99f8-3320a80b8725 to v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:26:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] create snapshot v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:26:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:26:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:26:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:26:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] create volume v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 from snapshot v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:26:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:26:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:26:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808', 'is_clone': True, 'full_name': 'Pool-0/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808', 'name': 'v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:26:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] get volume v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:26:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:26:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:26:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444186', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '113949', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10234515528679256155', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2dc21b29a29e6fd4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276376576', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87191', 'name': 'v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:26:17 user cinder-volume[73403]: DEBUG cinder.volume.volume_utils [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Marking volume 3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 as bootable. {{(pid=73403) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 03:26:17 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Copying metadata from image 98e6a247-250b-4bb5-a947-e7f93598d16e to 3a8e1f1a-36b6-47b7-95f2-d31cd1b55808. {{(pid=73403) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 03:26:17 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Creating volume glance metadata for volume 3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 backed by image 98e6a247-250b-4bb5-a947-e7f93598d16e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=73403) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 03:26:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a372bc15-fbf8-4b66-906e-72f6c61aa1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a8e1f1a-36b6-47b7-95f2-d31cd1b55808', 'volume_size': 1, 'image_id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '172ef384b95f49dc8d6e8f73eb7dae92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '98e6a247-250b-4bb5-a947-e7f93598d16e', 'created_at': datetime.datetime(2023, 4, 14, 2, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 2, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98e6a247-250b-4bb5-a947-e7f93598d16e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:26:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ea7dc4-762b-4a43-9ce5-1273719c3196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:26:17 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Volume volume-3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 (3a8e1f1a-36b6-47b7-95f2-d31cd1b55808): created successfully Apr 14 03:26:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ea7dc4-762b-4a43-9ce5-1273719c3196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:26:17 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Flow 'volume_create_manager' (689682ed-cae1-45fb-befc-59381bbd8a81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:26:17 user cinder-volume[73403]: INFO cinder.volume.manager [None req-0f43f517-39fb-4c35-995a-743247f8e35b tempest-TestShelveInstance-1966208901 None] Created volume successfully. Apr 14 03:26:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] create export for volume: 3a8e1f1a-36b6-47b7-95f2-d31cd1b55808. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:26:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] ensure volume 3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:26:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] check if targe iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:26:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:26:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:26:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:26:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] create target and attach volume 3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:26:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] create target iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:26:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:26:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:26:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:26:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] atach volume v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 to target iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:26:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:26:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:26:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3264633231623239', 'lun': 0, 'mode': 'wt', 'name': 'v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808', 'prod_id': 'Storage', 'scsi_id': '2dc21b29a29e6fd4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:26:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] add credentails to target iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:26:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:26:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:26:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] Geting {'code': 201, 'error': None, 'data': {'name': 'TcJSZhIU'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:26:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] initialize_connection for 3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:26:25 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TcJSZhIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '857453f9-dc5f-4e5f-8899-e783d463ef89'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:26:25 user cinder-volume[73403]: INFO cinder.volume.manager [req-3d42bc61-7184-4f03-addb-02d10e4a0ce6 req-a2c973db-d966-4fba-854c-42935f62b543 tempest-TestShelveInstance-1966208901 None] attachment_update completed successfully. Apr 14 03:26:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=18,cinder:SELECT=46,cinder:INSERT=8,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:42 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=29,cinder:UPDATE=6,cinder:INSERT=7 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:26:49 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:26:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Flow 'volume_create_manager' (ecdef644-dc67-48a8-ac87-7a6214bb37e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:26:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac4982d2-f1ae-4c14-a29d-504636590857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:26:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac4982d2-f1ae-4c14-a29d-504636590857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1026595092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7ef98f79-a820-44e4-bde2-010a709dc93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b689b65111045168cf21c51bf1274f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:26:49Z,use_quota=True,user_id='c1390cde350341c3ac0275e429146cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:26:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f330e9f-6f9c-4270-aca7-e11508580e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:26:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f330e9f-6f9c-4270-aca7-e11508580e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:26:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e5017c-c740-40d9-9d3d-cb40cc276eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:26:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e5017c-c740-40d9-9d3d-cb40cc276eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ef98f79-a820-44e4-bde2-010a709dc93c', 'volume_name': 'volume-7ef98f79-a820-44e4-bde2-010a709dc93c', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:26:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bcf687-9959-4937-bf8e-2d3cb67ca0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:26:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bcf687-9959-4937-bf8e-2d3cb67ca0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:26:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce8c35a-40d7-4fb8-a5f5-da184d72bc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:26:49 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Volume 7ef98f79-a820-44e4-bde2-010a709dc93c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ef98f79-a820-44e4-bde2-010a709dc93c', 'volume_size': 1} Apr 14 03:26:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] creating volume v_7ef98f79-a820-44e4-bde2-010a709dc93c. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:26:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] create volume {'name': 'v_7ef98f79-a820-44e4-bde2-010a709dc93c', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:26:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:26:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:26:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_7ef98f79-a820-44e4-bde2-010a709dc93c', 'is_clone': False, 'name': 'v_7ef98f79-a820-44e4-bde2-010a709dc93c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:26:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce8c35a-40d7-4fb8-a5f5-da184d72bc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ef98f79-a820-44e4-bde2-010a709dc93c', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:26:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe53701-398b-4ee9-b47a-d2838668e975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:26:50 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Volume volume-7ef98f79-a820-44e4-bde2-010a709dc93c (7ef98f79-a820-44e4-bde2-010a709dc93c): created successfully Apr 14 03:26:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe53701-398b-4ee9-b47a-d2838668e975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:26:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Flow 'volume_create_manager' (ecdef644-dc67-48a8-ac87-7a6214bb37e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:26:50 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a3332573-627d-4f19-87e8-836b23f78b3c tempest-AttachVolumeNegativeTest-376301777 None] Created volume successfully. Apr 14 03:26:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] create export for volume: 7ef98f79-a820-44e4-bde2-010a709dc93c. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:26:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] ensure volume 7ef98f79-a820-44e4-bde2-010a709dc93c assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:26:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] check if targe iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:26:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:26:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:26:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:26:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] create target and attach volume 7ef98f79-a820-44e4-bde2-010a709dc93c to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:26:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] create target iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:26:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:26:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:26:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:26:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] atach volume v_7ef98f79-a820-44e4-bde2-010a709dc93c to target iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:26:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:26:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:26:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6532393537333930', 'lun': 0, 'mode': 'wt', 'name': 'v_7ef98f79-a820-44e4-bde2-010a709dc93c', 'prod_id': 'Storage', 'scsi_id': 'e2957390eb4a045d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:26:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] add credentails to target iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:26:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:26:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:26:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 201, 'error': None, 'data': {'name': 'EyFqhPUm'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:26:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] initialize_connection for 7ef98f79-a820-44e4-bde2-010a709dc93c 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:26:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EyFqhPUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'cd271231-6906-48c9-a478-0306a67b7719'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:26:56 user cinder-volume[73403]: INFO cinder.volume.manager [req-55017929-b33b-45bd-81cb-0fe8c6267b2d req-fc0cc008-cdcc-4788-8d11-199f6371e86f tempest-AttachVolumeNegativeTest-376301777 None] attachment_update completed successfully. Apr 14 03:26:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e18747fa-f296-4ff7-bc91-6b6c2779f168 req-b437bda4-7bbc-40fa-bf86-45e3f1532104 tempest-AttachVolumeNegativeTest-376301777 None] terminate connection for 7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:26:59 user cinder-volume[73403]: INFO cinder.volume.manager [req-e18747fa-f296-4ff7-bc91-6b6c2779f168 req-b437bda4-7bbc-40fa-bf86-45e3f1532104 tempest-AttachVolumeNegativeTest-376301777 None] Terminate volume connection completed successfully. Apr 14 03:26:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-e18747fa-f296-4ff7-bc91-6b6c2779f168 req-b437bda4-7bbc-40fa-bf86-45e3f1532104 tempest-AttachVolumeNegativeTest-376301777 None] Deleting attachment cd271231-6906-48c9-a478-0306a67b7719. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:26:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e18747fa-f296-4ff7-bc91-6b6c2779f168 req-b437bda4-7bbc-40fa-bf86-45e3f1532104 tempest-AttachVolumeNegativeTest-376301777 None] remove_export for volume: 7ef98f79-a820-44e4-bde2-010a709dc93c. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:26:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e18747fa-f296-4ff7-bc91-6b6c2779f168 req-b437bda4-7bbc-40fa-bf86-45e3f1532104 tempest-AttachVolumeNegativeTest-376301777 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:26:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e18747fa-f296-4ff7-bc91-6b6c2779f168 req-b437bda4-7bbc-40fa-bf86-45e3f1532104 tempest-AttachVolumeNegativeTest-376301777 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1026595092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7ef98f79-a820-44e4-bde2-010a709dc93c,launched_at=2023-04-14T03:26:50Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='3b689b65111045168cf21c51bf1274f2',provider_auth='CHAP EyFqhPUm qnD1vze56COdIM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:26:49Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:26:59Z,use_quota=True,user_id='c1390cde350341c3ac0275e429146cf8',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:26:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e18747fa-f296-4ff7-bc91-6b6c2779f168 req-b437bda4-7bbc-40fa-bf86-45e3f1532104 tempest-AttachVolumeNegativeTest-376301777 None] detach volume v_7ef98f79-a820-44e4-bde2-010a709dc93c from target iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:26:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e18747fa-f296-4ff7-bc91-6b6c2779f168 req-b437bda4-7bbc-40fa-bf86-45e3f1532104 tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c/luns/v_7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:26:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e18747fa-f296-4ff7-bc91-6b6c2779f168 req-b437bda4-7bbc-40fa-bf86-45e3f1532104 tempest-AttachVolumeNegativeTest-376301777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c/luns/v_7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:26:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e18747fa-f296-4ff7-bc91-6b6c2779f168 req-b437bda4-7bbc-40fa-bf86-45e3f1532104 tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c/luns/v_7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:26:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e18747fa-f296-4ff7-bc91-6b6c2779f168 req-b437bda4-7bbc-40fa-bf86-45e3f1532104 tempest-AttachVolumeNegativeTest-376301777 None] delete target: iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:26:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e18747fa-f296-4ff7-bc91-6b6c2779f168 req-b437bda4-7bbc-40fa-bf86-45e3f1532104 tempest-AttachVolumeNegativeTest-376301777 None] delete target iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:26:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e18747fa-f296-4ff7-bc91-6b6c2779f168 req-b437bda4-7bbc-40fa-bf86-45e3f1532104 tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:26:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e18747fa-f296-4ff7-bc91-6b6c2779f168 req-b437bda4-7bbc-40fa-bf86-45e3f1532104 tempest-AttachVolumeNegativeTest-376301777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:27:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e18747fa-f296-4ff7-bc91-6b6c2779f168 req-b437bda4-7bbc-40fa-bf86-45e3f1532104 tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:27:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e18747fa-f296-4ff7-bc91-6b6c2779f168 req-b437bda4-7bbc-40fa-bf86-45e3f1532104 tempest-AttachVolumeNegativeTest-376301777 None] target iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:27:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:27:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:27:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:27:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:27:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:27:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114266112000', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:27:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:27:03 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:27:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=25,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:27:22 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=23,cinder:UPDATE=8 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:27:31 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:27:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Flow 'volume_create_manager' (abc6cd3d-f9b8-4311-9435-fbaeb234a1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:27:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d65e4e1-c76d-4f04-96fe-94b5e1e577ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:27:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d65e4e1-c76d-4f04-96fe-94b5e1e577ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-157469382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=206ed030-e355-423f-a35a-3598ef189cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed26668c2cb49c38d16ff728d38bef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:27:32Z,use_quota=True,user_id='f88237b825b24effad17900bbf645ab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:27:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2214b7-b0dd-4c31-ab8d-32b5a6a4f843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:27:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2214b7-b0dd-4c31-ab8d-32b5a6a4f843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:27:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8522458c-46c1-4b6f-8dab-4f62d598fe39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:27:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8522458c-46c1-4b6f-8dab-4f62d598fe39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '206ed030-e355-423f-a35a-3598ef189cce', 'volume_name': 'volume-206ed030-e355-423f-a35a-3598ef189cce', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:27:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7baf840c-5470-42fd-805a-037b9aac2c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:27:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7baf840c-5470-42fd-805a-037b9aac2c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:27:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab99300e-9e5e-4598-ad14-c8b75a67ea68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:27:31 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Volume 206ed030-e355-423f-a35a-3598ef189cce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-206ed030-e355-423f-a35a-3598ef189cce', 'volume_size': 1} Apr 14 03:27:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] creating volume v_206ed030-e355-423f-a35a-3598ef189cce. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:27:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] create volume {'name': 'v_206ed030-e355-423f-a35a-3598ef189cce', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:27:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:27:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:27:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_206ed030-e355-423f-a35a-3598ef189cce', 'is_clone': False, 'name': 'v_206ed030-e355-423f-a35a-3598ef189cce'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:27:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab99300e-9e5e-4598-ad14-c8b75a67ea68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-206ed030-e355-423f-a35a-3598ef189cce', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:27:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8befe498-6ee0-4134-a0a5-70c93695f371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:27:32 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Volume volume-206ed030-e355-423f-a35a-3598ef189cce (206ed030-e355-423f-a35a-3598ef189cce): created successfully Apr 14 03:27:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8befe498-6ee0-4134-a0a5-70c93695f371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:27:32 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Flow 'volume_create_manager' (abc6cd3d-f9b8-4311-9435-fbaeb234a1b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:27:32 user cinder-volume[73403]: INFO cinder.volume.manager [None req-c5e69dae-1d0a-4574-bad2-cfe2730ab77d tempest-AttachVolumeShelveTestJSON-1546459049 None] Created volume successfully. Apr 14 03:27:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-85284b7d-4b51-487d-847b-27ece93a8bc6 req-0bf51384-c0f9-4f25-8552-6e6ed7f62394 tempest-TestMinimumBasicScenario-144187586 None] terminate connection for 5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:27:37 user cinder-volume[73403]: INFO cinder.volume.manager [req-85284b7d-4b51-487d-847b-27ece93a8bc6 req-0bf51384-c0f9-4f25-8552-6e6ed7f62394 tempest-TestMinimumBasicScenario-144187586 None] Terminate volume connection completed successfully. Apr 14 03:27:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-85284b7d-4b51-487d-847b-27ece93a8bc6 req-0bf51384-c0f9-4f25-8552-6e6ed7f62394 tempest-TestMinimumBasicScenario-144187586 None] Deleting attachment 5abc96a7-2db7-4fbc-aa97-121b04fc25a5. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:27:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-85284b7d-4b51-487d-847b-27ece93a8bc6 req-0bf51384-c0f9-4f25-8552-6e6ed7f62394 tempest-TestMinimumBasicScenario-144187586 None] remove_export for volume: 5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:27:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-85284b7d-4b51-487d-847b-27ece93a8bc6 req-0bf51384-c0f9-4f25-8552-6e6ed7f62394 tempest-TestMinimumBasicScenario-144187586 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:27:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-85284b7d-4b51-487d-847b-27ece93a8bc6 req-0bf51384-c0f9-4f25-8552-6e6ed7f62394 tempest-TestMinimumBasicScenario-144187586 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-609416730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f,launched_at=2023-04-14T03:25:31Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0bd451b3f6734fe3ac0a8e8a853bb9eb',provider_auth='CHAP riVmtpEC QEV8qjD53i6Zvt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:25:29Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:27:37Z,use_quota=True,user_id='12199a43298942898a2e694ee2c5230e',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:27:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-85284b7d-4b51-487d-847b-27ece93a8bc6 req-0bf51384-c0f9-4f25-8552-6e6ed7f62394 tempest-TestMinimumBasicScenario-144187586 None] detach volume v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f from target iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:27:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-85284b7d-4b51-487d-847b-27ece93a8bc6 req-0bf51384-c0f9-4f25-8552-6e6ed7f62394 tempest-TestMinimumBasicScenario-144187586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f/luns/v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:27:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-85284b7d-4b51-487d-847b-27ece93a8bc6 req-0bf51384-c0f9-4f25-8552-6e6ed7f62394 tempest-TestMinimumBasicScenario-144187586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f/luns/v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:27:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-85284b7d-4b51-487d-847b-27ece93a8bc6 req-0bf51384-c0f9-4f25-8552-6e6ed7f62394 tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f/luns/v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:27:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-85284b7d-4b51-487d-847b-27ece93a8bc6 req-0bf51384-c0f9-4f25-8552-6e6ed7f62394 tempest-TestMinimumBasicScenario-144187586 None] delete target: iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:27:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-85284b7d-4b51-487d-847b-27ece93a8bc6 req-0bf51384-c0f9-4f25-8552-6e6ed7f62394 tempest-TestMinimumBasicScenario-144187586 None] delete target iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:27:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-85284b7d-4b51-487d-847b-27ece93a8bc6 req-0bf51384-c0f9-4f25-8552-6e6ed7f62394 tempest-TestMinimumBasicScenario-144187586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:27:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-85284b7d-4b51-487d-847b-27ece93a8bc6 req-0bf51384-c0f9-4f25-8552-6e6ed7f62394 tempest-TestMinimumBasicScenario-144187586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:27:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-85284b7d-4b51-487d-847b-27ece93a8bc6 req-0bf51384-c0f9-4f25-8552-6e6ed7f62394 tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:27:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-85284b7d-4b51-487d-847b-27ece93a8bc6 req-0bf51384-c0f9-4f25-8552-6e6ed7f62394 tempest-TestMinimumBasicScenario-144187586 None] target iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:27:52 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=11 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:27:52 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=13,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:28:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:28:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:28:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:28:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:28:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:28:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114265993216', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:28:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:28:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:28:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-efcf0a7f-c9bf-428d-a017-4790e845a63a req-30c45d51-b918-497f-bbe0-fa5f02dd9b28 tempest-TestShelveInstance-1966208901 None] terminate connection for 3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:28:14 user cinder-volume[73403]: INFO cinder.volume.manager [req-efcf0a7f-c9bf-428d-a017-4790e845a63a req-30c45d51-b918-497f-bbe0-fa5f02dd9b28 tempest-TestShelveInstance-1966208901 None] Terminate volume connection completed successfully. Apr 14 03:28:14 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-efcf0a7f-c9bf-428d-a017-4790e845a63a req-30c45d51-b918-497f-bbe0-fa5f02dd9b28 tempest-TestShelveInstance-1966208901 None] Deleting attachment 857453f9-dc5f-4e5f-8899-e783d463ef89. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:28:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-efcf0a7f-c9bf-428d-a017-4790e845a63a req-30c45d51-b918-497f-bbe0-fa5f02dd9b28 tempest-TestShelveInstance-1966208901 None] remove_export for volume: 3a8e1f1a-36b6-47b7-95f2-d31cd1b55808. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:28:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-efcf0a7f-c9bf-428d-a017-4790e845a63a req-30c45d51-b918-497f-bbe0-fa5f02dd9b28 tempest-TestShelveInstance-1966208901 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:28:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-efcf0a7f-c9bf-428d-a017-4790e845a63a req-30c45d51-b918-497f-bbe0-fa5f02dd9b28 tempest-TestShelveInstance-1966208901 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1037613746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3a8e1f1a-36b6-47b7-95f2-d31cd1b55808,launched_at=2023-04-14T03:26:18Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='1e0979cf1834435bb0007899da52e863',provider_auth='CHAP TcJSZhIU DzvfZV8Xkx4RG0',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:26:16Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:26:25Z,use_quota=True,user_id='61f477304a044148ade1c6acffd30712',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:28:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-efcf0a7f-c9bf-428d-a017-4790e845a63a req-30c45d51-b918-497f-bbe0-fa5f02dd9b28 tempest-TestShelveInstance-1966208901 None] detach volume v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 from target iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:28:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-efcf0a7f-c9bf-428d-a017-4790e845a63a req-30c45d51-b918-497f-bbe0-fa5f02dd9b28 tempest-TestShelveInstance-1966208901 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/luns/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:28:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-efcf0a7f-c9bf-428d-a017-4790e845a63a req-30c45d51-b918-497f-bbe0-fa5f02dd9b28 tempest-TestShelveInstance-1966208901 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/luns/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:28:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-efcf0a7f-c9bf-428d-a017-4790e845a63a req-30c45d51-b918-497f-bbe0-fa5f02dd9b28 tempest-TestShelveInstance-1966208901 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/luns/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:28:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-efcf0a7f-c9bf-428d-a017-4790e845a63a req-30c45d51-b918-497f-bbe0-fa5f02dd9b28 tempest-TestShelveInstance-1966208901 None] delete target: iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:28:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-efcf0a7f-c9bf-428d-a017-4790e845a63a req-30c45d51-b918-497f-bbe0-fa5f02dd9b28 tempest-TestShelveInstance-1966208901 None] delete target iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:28:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-efcf0a7f-c9bf-428d-a017-4790e845a63a req-30c45d51-b918-497f-bbe0-fa5f02dd9b28 tempest-TestShelveInstance-1966208901 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:28:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-efcf0a7f-c9bf-428d-a017-4790e845a63a req-30c45d51-b918-497f-bbe0-fa5f02dd9b28 tempest-TestShelveInstance-1966208901 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:28:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-efcf0a7f-c9bf-428d-a017-4790e845a63a req-30c45d51-b918-497f-bbe0-fa5f02dd9b28 tempest-TestShelveInstance-1966208901 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:28:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-efcf0a7f-c9bf-428d-a017-4790e845a63a req-30c45d51-b918-497f-bbe0-fa5f02dd9b28 tempest-TestShelveInstance-1966208901 None] target iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:28:22 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=1,cinder:SELECT=9 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Acquiring lock "cinder-5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Lock "cinder-5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] remove_export for volume: 5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-609416730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f,launched_at=2023-04-14T03:25:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd451b3f6734fe3ac0a8e8a853bb9eb',provider_auth='CHAP riVmtpEC QEV8qjD53i6Zvt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:25:29Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:28:27Z,updated_at=2023-04-14T03:28:27Z,use_quota=True,user_id='12199a43298942898a2e694ee2c5230e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] detach volume v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f from target iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f/luns/v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f/luns/v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f/luns/v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f/luns/v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] failed to remove resource iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f because of JDSS resource v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] delete target: iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] delete target iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] failed to remove resource iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f because of JDSS resource iqn.2010-10.org.openstack:5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] deleating volume v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] get snapshots for volume v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] get volume v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444139', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113930', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16474370332104213057', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'da2dcacb4dcdd27f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265989120', 'san:volume_id': 'da2dcacb4dcdd27f0a4900849332a9657689715e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87296', 'name': 'v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] delete volume:v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:28:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:28:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:28:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] volume v_5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:28:31 user cinder-volume[73403]: DEBUG cinder.quota [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Created reservations ['fba4d909-14f7-4baa-bd54-fbf1117dccfd', '0aab0e84-2dd6-45f3-b602-ae1d5cd2d9e0', '7edf4553-feab-4c44-9890-a1be22ea9078', '08bf47d5-8e88-412f-bd3e-5cf80e96673b'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:28:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:28:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:28:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:28:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:28:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Geting {'code': 200, 'error': None, 'data': {'available': '114266071040', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:28:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:28:32 user cinder-volume[73403]: DEBUG cinder.manager [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:28:32 user cinder-volume[73403]: INFO cinder.volume.manager [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Deleted volume successfully. Apr 14 03:28:32 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ca23c5e1-2317-47c3-998f-4d806b4adf38 tempest-TestMinimumBasicScenario-144187586 None] Lock "cinder-5b83278d-f8ec-4fad-95e2-f1e5f3e7f27f-delete_volume" released by "delete_volume" :: held 5.182s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:28:52 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=12,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:28:52 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=20,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:29:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:29:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:29:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114266071040', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:29:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:29:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:22 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] create export for volume: 206ed030-e355-423f-a35a-3598ef189cce. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:29:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] ensure volume 206ed030-e355-423f-a35a-3598ef189cce assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:29:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] check if targe iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:29:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] create target and attach volume 206ed030-e355-423f-a35a-3598ef189cce to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:29:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] create target iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:29:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] atach volume v_206ed030-e355-423f-a35a-3598ef189cce to target iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:29:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6266363739303934', 'lun': 0, 'mode': 'wt', 'name': 'v_206ed030-e355-423f-a35a-3598ef189cce', 'prod_id': 'Storage', 'scsi_id': 'bf67909486a8b23a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] add credentails to target iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] Geting {'code': 201, 'error': None, 'data': {'name': 'FkuMDwZI'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] initialize_connection for 206ed030-e355-423f-a35a-3598ef189cce 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FkuMDwZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '2f84256b-41b3-4369-bf80-046385b17ed3'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:29:31 user cinder-volume[73403]: INFO cinder.volume.manager [req-82abefc7-c9d8-4565-85f6-f54cce5db684 req-b2b4ab6b-2acb-46b7-9074-676384d2b3d5 tempest-AttachVolumeShelveTestJSON-1546459049 None] attachment_update completed successfully. Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Flow 'volume_create_manager' (041fd4be-4831-42d6-9845-e4005b8402c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dad3c32-1cec-405e-8659-dfaaa3bc0a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dad3c32-1cec-405e-8659-dfaaa3bc0a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-1433502605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b9e22dcb-9473-4c57-931f-8576c4db3bff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9db9df322ac40ddb5d5db5b059dbe5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:29:32Z,use_quota=True,user_id='1306aec94e324d1eb7c3bbb3eb2aabe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3076bde-84d3-468a-a206-5409546776d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3076bde-84d3-468a-a206-5409546776d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101a98ce-0f63-4110-a03c-80f98569e410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101a98ce-0f63-4110-a03c-80f98569e410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e22dcb-9473-4c57-931f-8576c4db3bff', 'volume_name': 'volume-b9e22dcb-9473-4c57-931f-8576c4db3bff', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f12a7b5-5ec6-44aa-a799-e064847d49d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f12a7b5-5ec6-44aa-a799-e064847d49d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74d9bcf-6c60-40cf-af46-c689f30afe77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:29:31 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Volume b9e22dcb-9473-4c57-931f-8576c4db3bff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e22dcb-9473-4c57-931f-8576c4db3bff', 'volume_size': 1} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] creating volume v_b9e22dcb-9473-4c57-931f-8576c4db3bff. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] create volume {'name': 'v_b9e22dcb-9473-4c57-931f-8576c4db3bff', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b9e22dcb-9473-4c57-931f-8576c4db3bff', 'is_clone': False, 'name': 'v_b9e22dcb-9473-4c57-931f-8576c4db3bff'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:33 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74d9bcf-6c60-40cf-af46-c689f30afe77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e22dcb-9473-4c57-931f-8576c4db3bff', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:29:33 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d34578d-1e5c-46c7-a05c-f197e34ab700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:29:33 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Volume volume-b9e22dcb-9473-4c57-931f-8576c4db3bff (b9e22dcb-9473-4c57-931f-8576c4db3bff): created successfully Apr 14 03:29:33 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d34578d-1e5c-46c7-a05c-f197e34ab700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:29:33 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Flow 'volume_create_manager' (041fd4be-4831-42d6-9845-e4005b8402c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:29:33 user cinder-volume[73403]: INFO cinder.volume.manager [None req-bf083294-a89a-4a15-a3af-9b62577b50c1 tempest-VolumeRevertTests-923795958 None] Created volume successfully. Apr 14 03:29:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35e728e9-364e-44e9-bbb8-f50a8df0c30f tempest-VolumeRevertTests-923795958 None] create snapshot 1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a for volume b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:29:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-35e728e9-364e-44e9-bbb8-f50a8df0c30f tempest-VolumeRevertTests-923795958 None] cloning v_b9e22dcb-9473-4c57-931f-8576c4db3bff to s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:29:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35e728e9-364e-44e9-bbb8-f50a8df0c30f tempest-VolumeRevertTests-923795958 None] create snapshot s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:29:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35e728e9-364e-44e9-bbb8-f50a8df0c30f tempest-VolumeRevertTests-923795958 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35e728e9-364e-44e9-bbb8-f50a8df0c30f tempest-VolumeRevertTests-923795958 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35e728e9-364e-44e9-bbb8-f50a8df0c30f tempest-VolumeRevertTests-923795958 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35e728e9-364e-44e9-bbb8-f50a8df0c30f tempest-VolumeRevertTests-923795958 None] create volume s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a from snapshot s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:29:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35e728e9-364e-44e9-bbb8-f50a8df0c30f tempest-VolumeRevertTests-923795958 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35e728e9-364e-44e9-bbb8-f50a8df0c30f tempest-VolumeRevertTests-923795958 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35e728e9-364e-44e9-bbb8-f50a8df0c30f tempest-VolumeRevertTests-923795958 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b9e22dcb-9473-4c57-931f-8576c4db3bff@s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a', 'is_clone': True, 'full_name': 'Pool-0/s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a', 'name': 's_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35e728e9-364e-44e9-bbb8-f50a8df0c30f tempest-VolumeRevertTests-923795958 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35e728e9-364e-44e9-bbb8-f50a8df0c30f tempest-VolumeRevertTests-923795958 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-35e728e9-364e-44e9-bbb8-f50a8df0c30f tempest-VolumeRevertTests-923795958 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-35e728e9-364e-44e9-bbb8-f50a8df0c30f tempest-VolumeRevertTests-923795958 None] volume s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:29:36 user cinder-volume[73403]: INFO cinder.volume.manager [None req-35e728e9-364e-44e9-bbb8-f50a8df0c30f tempest-VolumeRevertTests-923795958 None] Create snapshot completed successfully Apr 14 03:29:37 user cinder-volume[73403]: INFO cinder.volume.manager [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Start to perform revert to snapshot process. Apr 14 03:29:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] create snapshot f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9 for volume b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:29:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] cloning v_b9e22dcb-9473-4c57-931f-8576c4db3bff to s_f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:29:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] create snapshot s_f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:29:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] create volume s_f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9 from snapshot s_f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:29:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b9e22dcb-9473-4c57-931f-8576c4db3bff@s_f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9', 'is_clone': True, 'full_name': 'Pool-0/s_f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9', 'name': 's_f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] volume s_f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:29:39 user cinder-volume[73403]: INFO cinder.volume.manager [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Create snapshot completed successfully Apr 14 03:29:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] reverting v_b9e22dcb-9473-4c57-931f-8576c4db3bff to s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a {{(pid=73403) revert_to_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:420}} Apr 14 03:29:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] get volume v_b9e22dcb-9473-4c57-931f-8576c4db3bff info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:29:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b9e22dcb-9473-4c57-931f-8576c4db3bff', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444381', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114014', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2027688736721385393', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e877f97556eb093d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265939968', 'san:volume_id': 'e877f97556eb093ddf9942c8c800f86587cb15a0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86224', 'name': 'v_b9e22dcb-9473-4c57-931f-8576c4db3bff', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] rollback volume v_b9e22dcb-9473-4c57-931f-8576c4db3bff to snapshot s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a {{(pid=73403) rollback_volume_to_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:707}} Apr 14 03:29:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/snapshots/s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a/rollback {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/snapshots/s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a/rollback {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Geting {'code': 200, 'error': None, 'data': None} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/snapshots/s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a/rollback {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] get volume v_b9e22dcb-9473-4c57-931f-8576c4db3bff info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:29:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b9e22dcb-9473-4c57-931f-8576c4db3bff', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444381', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114014', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2027688736721385393', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e877f97556eb093d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265952256', 'san:volume_id': 'e877f97556eb093ddf9942c8c800f86587cb15a0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86224', 'name': 'v_b9e22dcb-9473-4c57-931f-8576c4db3bff', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:43 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=35,cinder:UPDATE=5,cinder:DELETE=1,cinder:INSERT=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:43 user cinder-volume[73403]: DEBUG cinder.coordination [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Acquiring lock "cinder-f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:29:43 user cinder-volume[73403]: DEBUG cinder.coordination [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Lock "cinder-f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:29:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] deleating snapshot s_f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:29:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] get snapshots for volume s_f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:29:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Geting {'code': 500, 'error': {'class': 'zfslib.zfsapi.resources.ZfsResourceError', 'errno': 1, 'message': 'Zfs resource: Pool-0/s_f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9 not found in this collection.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9/snapshots'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] physical volume s_f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9 dne, it was already deleted. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:655}} Apr 14 03:29:44 user cinder-volume[73403]: INFO cinder.volume.manager [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Delete snapshot completed successfully. Apr 14 03:29:44 user cinder-volume[73403]: DEBUG cinder.coordination [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Lock "cinder-f96dd854-02d1-46fc-9b7a-ac12fd9bc9d9-delete_snapshot" released by "delete_snapshot" :: held 0.071s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:29:44 user cinder-volume[73403]: INFO cinder.volume.manager [None req-1c1b8c72-498b-48b4-b80b-2b84ad0a5cf8 tempest-VolumeRevertTests-923795958 None] Volume b9e22dcb-9473-4c57-931f-8576c4db3bff reverted to snapshot 1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a successfully. Apr 14 03:29:44 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:29:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Flow 'volume_create_manager' (7159d18b-de81-412d-b3d1-ff6d4fb3a126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:29:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e12b094-9e56-4c42-b3f4-9a7e9b46cc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:29:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e12b094-9e56-4c42-b3f4-9a7e9b46cc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-1252857337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=00de581e-0576-44df-809e-fb9727874103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9db9df322ac40ddb5d5db5b059dbe5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:29:44Z,use_quota=True,user_id='1306aec94e324d1eb7c3bbb3eb2aabe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:29:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15eed267-25b1-4d9a-ae19-60c567d4c039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:29:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15eed267-25b1-4d9a-ae19-60c567d4c039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:29:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd744287-91a0-49af-bd33-0d700312ecbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:29:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd744287-91a0-49af-bd33-0d700312ecbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00de581e-0576-44df-809e-fb9727874103', 'volume_name': 'volume-00de581e-0576-44df-809e-fb9727874103', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:29:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344553d6-b444-4166-99ed-356b3308a1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:29:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344553d6-b444-4166-99ed-356b3308a1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:29:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88f0c28-d4b8-4c07-82c2-717de88f06b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:29:44 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Volume 00de581e-0576-44df-809e-fb9727874103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00de581e-0576-44df-809e-fb9727874103', 'volume_size': 1} Apr 14 03:29:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] creating volume v_00de581e-0576-44df-809e-fb9727874103. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:29:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] create volume {'name': 'v_00de581e-0576-44df-809e-fb9727874103', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:29:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_00de581e-0576-44df-809e-fb9727874103', 'is_clone': False, 'name': 'v_00de581e-0576-44df-809e-fb9727874103'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88f0c28-d4b8-4c07-82c2-717de88f06b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00de581e-0576-44df-809e-fb9727874103', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:29:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f378aa40-c886-45c0-9d55-f28d6c641aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:29:45 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Volume volume-00de581e-0576-44df-809e-fb9727874103 (00de581e-0576-44df-809e-fb9727874103): created successfully Apr 14 03:29:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f378aa40-c886-45c0-9d55-f28d6c641aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:29:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Flow 'volume_create_manager' (7159d18b-de81-412d-b3d1-ff6d4fb3a126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:29:45 user cinder-volume[73403]: INFO cinder.volume.manager [None req-dd0b7d16-e18a-4809-a463-0b6f6a5e98a7 tempest-VolumeRevertTests-923795958 None] Created volume successfully. Apr 14 03:29:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4806d1e9-a7a7-4a4d-9565-5d7e6687ca0b tempest-VolumeRevertTests-923795958 None] create snapshot ba0b1ce1-574c-46ad-93af-f470fbf19d9c for volume 00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:29:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4806d1e9-a7a7-4a4d-9565-5d7e6687ca0b tempest-VolumeRevertTests-923795958 None] cloning v_00de581e-0576-44df-809e-fb9727874103 to s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:29:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4806d1e9-a7a7-4a4d-9565-5d7e6687ca0b tempest-VolumeRevertTests-923795958 None] create snapshot s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:29:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4806d1e9-a7a7-4a4d-9565-5d7e6687ca0b tempest-VolumeRevertTests-923795958 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4806d1e9-a7a7-4a4d-9565-5d7e6687ca0b tempest-VolumeRevertTests-923795958 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4806d1e9-a7a7-4a4d-9565-5d7e6687ca0b tempest-VolumeRevertTests-923795958 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_ba0b1ce1-574c-46ad-93af-f470fbf19d9c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4806d1e9-a7a7-4a4d-9565-5d7e6687ca0b tempest-VolumeRevertTests-923795958 None] create volume s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c from snapshot s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:29:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4806d1e9-a7a7-4a4d-9565-5d7e6687ca0b tempest-VolumeRevertTests-923795958 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4806d1e9-a7a7-4a4d-9565-5d7e6687ca0b tempest-VolumeRevertTests-923795958 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4806d1e9-a7a7-4a4d-9565-5d7e6687ca0b tempest-VolumeRevertTests-923795958 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_00de581e-0576-44df-809e-fb9727874103@s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c', 'is_clone': True, 'full_name': 'Pool-0/s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c', 'name': 's_ba0b1ce1-574c-46ad-93af-f470fbf19d9c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4806d1e9-a7a7-4a4d-9565-5d7e6687ca0b tempest-VolumeRevertTests-923795958 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4806d1e9-a7a7-4a4d-9565-5d7e6687ca0b tempest-VolumeRevertTests-923795958 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4806d1e9-a7a7-4a4d-9565-5d7e6687ca0b tempest-VolumeRevertTests-923795958 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4806d1e9-a7a7-4a4d-9565-5d7e6687ca0b tempest-VolumeRevertTests-923795958 None] volume s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:29:48 user cinder-volume[73403]: INFO cinder.volume.manager [None req-4806d1e9-a7a7-4a4d-9565-5d7e6687ca0b tempest-VolumeRevertTests-923795958 None] Create snapshot completed successfully Apr 14 03:29:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dd6e0557-33cd-49cc-9598-e43bdca088c4 tempest-VolumeRevertTests-923795958 None] Extend volume 00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}} Apr 14 03:29:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dd6e0557-33cd-49cc-9598-e43bdca088c4 tempest-VolumeRevertTests-923795958 None] jdss extend volume v_00de581e-0576-44df-809e-fb9727874103 to 2147483648 {{(pid=73403) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}} Apr 14 03:29:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd6e0557-33cd-49cc-9598-e43bdca088c4 tempest-VolumeRevertTests-923795958 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd6e0557-33cd-49cc-9598-e43bdca088c4 tempest-VolumeRevertTests-923795958 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dd6e0557-33cd-49cc-9598-e43bdca088c4 tempest-VolumeRevertTests-923795958 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:49 user cinder-volume[73403]: INFO cinder.volume.manager [None req-dd6e0557-33cd-49cc-9598-e43bdca088c4 tempest-VolumeRevertTests-923795958 None] Extend volume completed successfully. Apr 14 03:29:50 user cinder-volume[73403]: DEBUG cinder.coordination [None req-91743d70-8273-4fee-8e71-1dcc9a929a8a tempest-VolumeRevertTests-923795958 None] Acquiring lock "cinder-ba0b1ce1-574c-46ad-93af-f470fbf19d9c-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:29:50 user cinder-volume[73403]: DEBUG cinder.coordination [None req-91743d70-8273-4fee-8e71-1dcc9a929a8a tempest-VolumeRevertTests-923795958 None] Lock "cinder-ba0b1ce1-574c-46ad-93af-f470fbf19d9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:29:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-91743d70-8273-4fee-8e71-1dcc9a929a8a tempest-VolumeRevertTests-923795958 None] deleating snapshot s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:29:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-91743d70-8273-4fee-8e71-1dcc9a929a8a tempest-VolumeRevertTests-923795958 None] get snapshots for volume s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:29:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91743d70-8273-4fee-8e71-1dcc9a929a8a tempest-VolumeRevertTests-923795958 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91743d70-8273-4fee-8e71-1dcc9a929a8a tempest-VolumeRevertTests-923795958 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91743d70-8273-4fee-8e71-1dcc9a929a8a tempest-VolumeRevertTests-923795958 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-91743d70-8273-4fee-8e71-1dcc9a929a8a tempest-VolumeRevertTests-923795958 None] get volume s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:29:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91743d70-8273-4fee-8e71-1dcc9a929a8a tempest-VolumeRevertTests-923795958 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91743d70-8273-4fee-8e71-1dcc9a929a8a tempest-VolumeRevertTests-923795958 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91743d70-8273-4fee-8e71-1dcc9a929a8a tempest-VolumeRevertTests-923795958 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_00de581e-0576-44df-809e-fb9727874103@s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444397', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114040', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5991015917315761381', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f74d4962661ee8b2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265800704', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87308', 'name': 's_ba0b1ce1-574c-46ad-93af-f470fbf19d9c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-91743d70-8273-4fee-8e71-1dcc9a929a8a tempest-VolumeRevertTests-923795958 None] delete snapshot s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c of volume v_00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:29:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91743d70-8273-4fee-8e71-1dcc9a929a8a tempest-VolumeRevertTests-923795958 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103/snapshots/s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91743d70-8273-4fee-8e71-1dcc9a929a8a tempest-VolumeRevertTests-923795958 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103/snapshots/s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91743d70-8273-4fee-8e71-1dcc9a929a8a tempest-VolumeRevertTests-923795958 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103/snapshots/s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-91743d70-8273-4fee-8e71-1dcc9a929a8a tempest-VolumeRevertTests-923795958 None] snapshot s_ba0b1ce1-574c-46ad-93af-f470fbf19d9c deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:29:52 user cinder-volume[73403]: DEBUG cinder.quota [None req-91743d70-8273-4fee-8e71-1dcc9a929a8a tempest-VolumeRevertTests-923795958 None] Created reservations ['7d69d792-8216-45e0-8ada-80ec528ae6d3', '8fa16848-8419-452e-861a-2cdc81af05d1', 'fce596c1-3229-4702-ac9e-c2c6d324e0fd', 'a6572674-339a-4d7f-9c7f-6bda48691007'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:29:52 user cinder-volume[73403]: INFO cinder.volume.manager [None req-91743d70-8273-4fee-8e71-1dcc9a929a8a tempest-VolumeRevertTests-923795958 None] Delete snapshot completed successfully. Apr 14 03:29:52 user cinder-volume[73403]: DEBUG cinder.coordination [None req-91743d70-8273-4fee-8e71-1dcc9a929a8a tempest-VolumeRevertTests-923795958 None] Lock "cinder-ba0b1ce1-574c-46ad-93af-f470fbf19d9c-delete_snapshot" released by "delete_snapshot" :: held 2.391s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.coordination [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Acquiring lock "cinder-00de581e-0576-44df-809e-fb9727874103-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.coordination [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Lock "cinder-00de581e-0576-44df-809e-fb9727874103-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=44,cinder:UPDATE=18,cinder:DELETE=4,cinder:INSERT=4 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] remove_export for volume: 00de581e-0576-44df-809e-fb9727874103. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-1252857337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=00de581e-0576-44df-809e-fb9727874103,launched_at=2023-04-14T03:29:46Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='c9db9df322ac40ddb5d5db5b059dbe5d',provider_auth='CHAP puhbXrOE cjV0m6dz3o58Za',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:00de581e-0576-44df-809e-fb9727874103 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:29:44Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:29:53Z,updated_at=2023-04-14T03:29:53Z,use_quota=True,user_id='1306aec94e324d1eb7c3bbb3eb2aabe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:00de581e-0576-44df-809e-fb9727874103. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] detach volume v_00de581e-0576-44df-809e-fb9727874103 from target iqn.2010-10.org.openstack:00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00de581e-0576-44df-809e-fb9727874103/luns/v_00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00de581e-0576-44df-809e-fb9727874103/luns/v_00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:00de581e-0576-44df-809e-fb9727874103 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00de581e-0576-44df-809e-fb9727874103/luns/v_00de581e-0576-44df-809e-fb9727874103'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00de581e-0576-44df-809e-fb9727874103/luns/v_00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] failed to remove resource iqn.2010-10.org.openstack:00de581e-0576-44df-809e-fb9727874103 because of JDSS resource v_00de581e-0576-44df-809e-fb9727874103 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] delete target: iqn.2010-10.org.openstack:00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] delete target iqn.2010-10.org.openstack:00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:00de581e-0576-44df-809e-fb9727874103 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00de581e-0576-44df-809e-fb9727874103'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] failed to remove resource iqn.2010-10.org.openstack:00de581e-0576-44df-809e-fb9727874103 because of JDSS resource iqn.2010-10.org.openstack:00de581e-0576-44df-809e-fb9727874103 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] deleating volume v_00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] get snapshots for volume v_00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] get volume v_00de581e-0576-44df-809e-fb9727874103 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_00de581e-0576-44df-809e-fb9727874103', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444394', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114034', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15156915405940735738', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '47ebc7f595ea1bec', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265870336', 'san:volume_id': '47ebc7f595ea1bec386650ab15ffb78e1585ec5d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87221', 'name': 'v_00de581e-0576-44df-809e-fb9727874103', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] delete volume:v_00de581e-0576-44df-809e-fb9727874103 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00de581e-0576-44df-809e-fb9727874103 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] volume v_00de581e-0576-44df-809e-fb9727874103 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:29:55 user cinder-volume[73403]: DEBUG cinder.quota [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Created reservations ['9542b693-eabd-44fe-88b7-94eb90617272', 'f1a7f9ff-c805-4ea7-a0f9-7e25273df2a3', '79b32bc3-7bdc-4dee-a901-d279f3edf848', '466cf51a-c466-440d-bcee-3bd28b740372'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:29:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:29:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:29:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Geting {'code': 200, 'error': None, 'data': {'available': '114265964544', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:29:56 user cinder-volume[73403]: DEBUG cinder.manager [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:29:56 user cinder-volume[73403]: INFO cinder.volume.manager [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Deleted volume successfully. Apr 14 03:29:56 user cinder-volume[73403]: DEBUG cinder.coordination [None req-d14ef6df-3ddd-4944-ab17-71922a42dc58 tempest-VolumeRevertTests-923795958 None] Lock "cinder-00de581e-0576-44df-809e-fb9727874103-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:29:56 user cinder-volume[73403]: DEBUG cinder.coordination [None req-fa9754b7-eec4-42a9-9fb7-274f8987f5ff tempest-VolumeRevertTests-923795958 None] Acquiring lock "cinder-1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:29:56 user cinder-volume[73403]: DEBUG cinder.coordination [None req-fa9754b7-eec4-42a9-9fb7-274f8987f5ff tempest-VolumeRevertTests-923795958 None] Lock "cinder-1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:29:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fa9754b7-eec4-42a9-9fb7-274f8987f5ff tempest-VolumeRevertTests-923795958 None] deleating snapshot s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:29:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa9754b7-eec4-42a9-9fb7-274f8987f5ff tempest-VolumeRevertTests-923795958 None] get snapshots for volume s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:29:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa9754b7-eec4-42a9-9fb7-274f8987f5ff tempest-VolumeRevertTests-923795958 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa9754b7-eec4-42a9-9fb7-274f8987f5ff tempest-VolumeRevertTests-923795958 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa9754b7-eec4-42a9-9fb7-274f8987f5ff tempest-VolumeRevertTests-923795958 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa9754b7-eec4-42a9-9fb7-274f8987f5ff tempest-VolumeRevertTests-923795958 None] get volume s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:29:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa9754b7-eec4-42a9-9fb7-274f8987f5ff tempest-VolumeRevertTests-923795958 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa9754b7-eec4-42a9-9fb7-274f8987f5ff tempest-VolumeRevertTests-923795958 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa9754b7-eec4-42a9-9fb7-274f8987f5ff tempest-VolumeRevertTests-923795958 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b9e22dcb-9473-4c57-931f-8576c4db3bff@s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444384', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114020', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11340513064444991426', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '961e0aa9037a9a33', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265964544', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87436', 'name': 's_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa9754b7-eec4-42a9-9fb7-274f8987f5ff tempest-VolumeRevertTests-923795958 None] delete snapshot s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a of volume v_b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:29:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa9754b7-eec4-42a9-9fb7-274f8987f5ff tempest-VolumeRevertTests-923795958 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/snapshots/s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa9754b7-eec4-42a9-9fb7-274f8987f5ff tempest-VolumeRevertTests-923795958 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/snapshots/s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa9754b7-eec4-42a9-9fb7-274f8987f5ff tempest-VolumeRevertTests-923795958 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/snapshots/s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa9754b7-eec4-42a9-9fb7-274f8987f5ff tempest-VolumeRevertTests-923795958 None] snapshot s_1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:29:58 user cinder-volume[73403]: DEBUG cinder.quota [None req-fa9754b7-eec4-42a9-9fb7-274f8987f5ff tempest-VolumeRevertTests-923795958 None] Created reservations ['d06f7d38-5d28-44d2-b4fa-1456d3634428', '9d968ea2-eaf8-462e-bb79-d4c0908efab9', '69c9d0d1-2991-4bf9-96fb-5a1951062c8e', '83266966-2c9e-4a12-b90d-44052b49b512'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:29:58 user cinder-volume[73403]: INFO cinder.volume.manager [None req-fa9754b7-eec4-42a9-9fb7-274f8987f5ff tempest-VolumeRevertTests-923795958 None] Delete snapshot completed successfully. Apr 14 03:29:58 user cinder-volume[73403]: DEBUG cinder.coordination [None req-fa9754b7-eec4-42a9-9fb7-274f8987f5ff tempest-VolumeRevertTests-923795958 None] Lock "cinder-1110b7da-aee9-4fe1-b0b9-5ec0433b2b1a-delete_snapshot" released by "delete_snapshot" :: held 2.136s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:29:59 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Acquiring lock "cinder-b9e22dcb-9473-4c57-931f-8576c4db3bff-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:29:59 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Lock "cinder-b9e22dcb-9473-4c57-931f-8576c4db3bff-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:29:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] remove_export for volume: b9e22dcb-9473-4c57-931f-8576c4db3bff. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:29:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:29:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-1433502605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b9e22dcb-9473-4c57-931f-8576c4db3bff,launched_at=2023-04-14T03:29:33Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9db9df322ac40ddb5d5db5b059dbe5d',provider_auth='CHAP pxOgDBGK qH9LOg83dBAKlh',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e22dcb-9473-4c57-931f-8576c4db3bff 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:29:32Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:30:00Z,updated_at=2023-04-14T03:30:00Z,use_quota=True,user_id='1306aec94e324d1eb7c3bbb3eb2aabe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:b9e22dcb-9473-4c57-931f-8576c4db3bff. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:29:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] detach volume v_b9e22dcb-9473-4c57-931f-8576c4db3bff from target iqn.2010-10.org.openstack:b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:29:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9e22dcb-9473-4c57-931f-8576c4db3bff/luns/v_b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9e22dcb-9473-4c57-931f-8576c4db3bff/luns/v_b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b9e22dcb-9473-4c57-931f-8576c4db3bff not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9e22dcb-9473-4c57-931f-8576c4db3bff/luns/v_b9e22dcb-9473-4c57-931f-8576c4db3bff'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9e22dcb-9473-4c57-931f-8576c4db3bff/luns/v_b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] failed to remove resource iqn.2010-10.org.openstack:b9e22dcb-9473-4c57-931f-8576c4db3bff because of JDSS resource v_b9e22dcb-9473-4c57-931f-8576c4db3bff DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:29:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] delete target: iqn.2010-10.org.openstack:b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:29:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] delete target iqn.2010-10.org.openstack:b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:29:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:29:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b9e22dcb-9473-4c57-931f-8576c4db3bff not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9e22dcb-9473-4c57-931f-8576c4db3bff'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:29:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] failed to remove resource iqn.2010-10.org.openstack:b9e22dcb-9473-4c57-931f-8576c4db3bff because of JDSS resource iqn.2010-10.org.openstack:b9e22dcb-9473-4c57-931f-8576c4db3bff DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:29:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] deleating volume v_b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:29:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] get snapshots for volume v_b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:29:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:29:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:30:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:30:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] get volume v_b9e22dcb-9473-4c57-931f-8576c4db3bff info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:30:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:30:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:30:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b9e22dcb-9473-4c57-931f-8576c4db3bff', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444381', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114014', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2027688736721385393', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e877f97556eb093d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265952256', 'san:volume_id': 'e877f97556eb093ddf9942c8c800f86587cb15a0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86224', 'name': 'v_b9e22dcb-9473-4c57-931f-8576c4db3bff', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:30:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] delete volume:v_b9e22dcb-9473-4c57-931f-8576c4db3bff recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:30:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:30:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:30:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9e22dcb-9473-4c57-931f-8576c4db3bff {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:30:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] volume v_b9e22dcb-9473-4c57-931f-8576c4db3bff deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:30:02 user cinder-volume[73403]: DEBUG cinder.quota [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Created reservations ['23022102-ed64-4425-a154-76f254dd7085', '071c935d-05d1-4fa2-b255-136418b7be41', '0e0e6e3d-7555-410b-b351-5f0b02c7a277', '247ec095-7489-4783-8918-275e9f1ce847'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:30:02 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=37,cinder:SELECT=59,cinder:INSERT=4 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:30:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:30:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:30:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:30:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Geting {'code': 200, 'error': None, 'data': {'available': '114266009600', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:30:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:30:02 user cinder-volume[73403]: DEBUG cinder.manager [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:30:02 user cinder-volume[73403]: INFO cinder.volume.manager [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Deleted volume successfully. Apr 14 03:30:02 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b161ccd2-e093-400b-baab-a4b1fcae2ab7 tempest-VolumeRevertTests-923795958 None] Lock "cinder-b9e22dcb-9473-4c57-931f-8576c4db3bff-delete_volume" released by "delete_volume" :: held 2.895s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:30:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:30:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:30:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:30:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:30:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:30:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114266009600', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:30:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:30:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:30:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] create export for volume: 3a8e1f1a-36b6-47b7-95f2-d31cd1b55808. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:30:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] ensure volume 3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:30:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] check if targe iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:30:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:30:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:30:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:30:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] create target and attach volume 3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:30:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] create target iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:30:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:30:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:30:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:30:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] atach volume v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 to target iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:30:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:30:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:30:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3264633231623239', 'lun': 0, 'mode': 'wt', 'name': 'v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808', 'prod_id': 'Storage', 'scsi_id': '2dc21b29a29e6fd4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:30:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] add credentails to target iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:30:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:30:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:30:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] Geting {'code': 201, 'error': None, 'data': {'name': 'TcJSZhIU'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:30:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] initialize_connection for 3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:30:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TcJSZhIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '007d4e50-5e3e-4810-9926-671483ce4061'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:30:08 user cinder-volume[73403]: INFO cinder.volume.manager [req-e491ff9a-a99a-4cc6-a075-e129c39966e3 req-31c5b9a8-5e3f-4719-a01d-8b367fbd171d tempest-TestShelveInstance-1966208901 None] attachment_update completed successfully. Apr 14 03:30:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=8,cinder:DELETE=1,cinder:SELECT=17 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=45,cinder:INSERT=9,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:30:36 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:30:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Flow 'volume_create_manager' (bd99d945-3772-41a7-a460-716991039d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:30:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5e0911-817d-4962-9681-d2e71ef9030f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:30:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5e0911-817d-4962-9681-d2e71ef9030f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-574258552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=52935d67-1254-4ae3-810b-7b1ffa098955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b689b65111045168cf21c51bf1274f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:30:37Z,use_quota=True,user_id='c1390cde350341c3ac0275e429146cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:30:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3fb192-2039-403c-9252-1e190232fc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:30:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3fb192-2039-403c-9252-1e190232fc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:30:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ada940-b7f8-4da3-bca4-2ab588eb21a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:30:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ada940-b7f8-4da3-bca4-2ab588eb21a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52935d67-1254-4ae3-810b-7b1ffa098955', 'volume_name': 'volume-52935d67-1254-4ae3-810b-7b1ffa098955', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:30:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14cd0660-58b9-4dc3-8ca6-aebe5e7ba698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:30:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14cd0660-58b9-4dc3-8ca6-aebe5e7ba698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:30:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eaefd79-6017-4e5d-9b08-a1326bb48dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:30:36 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Volume 52935d67-1254-4ae3-810b-7b1ffa098955: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52935d67-1254-4ae3-810b-7b1ffa098955', 'volume_size': 1} Apr 14 03:30:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] creating volume v_52935d67-1254-4ae3-810b-7b1ffa098955. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:30:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] create volume {'name': 'v_52935d67-1254-4ae3-810b-7b1ffa098955', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:30:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:30:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:30:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_52935d67-1254-4ae3-810b-7b1ffa098955', 'is_clone': False, 'name': 'v_52935d67-1254-4ae3-810b-7b1ffa098955'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:30:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eaefd79-6017-4e5d-9b08-a1326bb48dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52935d67-1254-4ae3-810b-7b1ffa098955', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:30:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7c9304-f94d-4be8-b652-f1fb403474b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:30:37 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Volume volume-52935d67-1254-4ae3-810b-7b1ffa098955 (52935d67-1254-4ae3-810b-7b1ffa098955): created successfully Apr 14 03:30:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7c9304-f94d-4be8-b652-f1fb403474b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:30:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Flow 'volume_create_manager' (bd99d945-3772-41a7-a460-716991039d25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:30:37 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a480dbc3-5a6f-4d9d-8684-fd1c978d38c3 tempest-AttachVolumeNegativeTest-376301777 None] Created volume successfully. Apr 14 03:30:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] create export for volume: 52935d67-1254-4ae3-810b-7b1ffa098955. {{(pid=73403) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 03:30:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] ensure volume 52935d67-1254-4ae3-810b-7b1ffa098955 assigned to a proper target {{(pid=73403) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 03:30:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] check if targe iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 exists {{(pid=73403) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 03:30:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:30:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:30:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:30:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] create target and attach volume 52935d67-1254-4ae3-810b-7b1ffa098955 to it {{(pid=73403) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 03:30:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] create target iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 03:30:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:30:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:30:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:30:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] atach volume v_52935d67-1254-4ae3-810b-7b1ffa098955 to target iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 03:30:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955/luns {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:30:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:30:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6262356462313330', 'lun': 0, 'mode': 'wt', 'name': 'v_52935d67-1254-4ae3-810b-7b1ffa098955', 'prod_id': 'Storage', 'scsi_id': 'bb5db13042f20413'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955/luns {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:30:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] add credentails to target iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 03:30:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955/incoming-users {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:30:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:30:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 201, 'error': None, 'data': {'name': 'AENZapny'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955/incoming-users {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:30:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] initialize_connection for 52935d67-1254-4ae3-810b-7b1ffa098955 10.0.0.210. {{(pid=73403) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 03:30:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AENZapny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'd1cbd8ee-9826-4935-9562-4f4d7400ba3b'} {{(pid=73403) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 03:30:42 user cinder-volume[73403]: INFO cinder.volume.manager [req-dd443342-9a5a-4bb4-b79c-d7014439b281 req-c529554c-76b2-436b-a0ee-22b9bd3468a2 tempest-AttachVolumeNegativeTest-376301777 None] attachment_update completed successfully. Apr 14 03:30:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-54d6d9e9-cd19-4390-9707-985a9c5dac9b req-f7e6d5b7-fd6a-4f97-87d0-3496d40e3967 tempest-AttachVolumeNegativeTest-376301777 None] terminate connection for 52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:30:45 user cinder-volume[73403]: INFO cinder.volume.manager [req-54d6d9e9-cd19-4390-9707-985a9c5dac9b req-f7e6d5b7-fd6a-4f97-87d0-3496d40e3967 tempest-AttachVolumeNegativeTest-376301777 None] Terminate volume connection completed successfully. Apr 14 03:30:45 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-54d6d9e9-cd19-4390-9707-985a9c5dac9b req-f7e6d5b7-fd6a-4f97-87d0-3496d40e3967 tempest-AttachVolumeNegativeTest-376301777 None] Deleting attachment d1cbd8ee-9826-4935-9562-4f4d7400ba3b. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:30:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-54d6d9e9-cd19-4390-9707-985a9c5dac9b req-f7e6d5b7-fd6a-4f97-87d0-3496d40e3967 tempest-AttachVolumeNegativeTest-376301777 None] remove_export for volume: 52935d67-1254-4ae3-810b-7b1ffa098955. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:30:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-54d6d9e9-cd19-4390-9707-985a9c5dac9b req-f7e6d5b7-fd6a-4f97-87d0-3496d40e3967 tempest-AttachVolumeNegativeTest-376301777 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:30:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-54d6d9e9-cd19-4390-9707-985a9c5dac9b req-f7e6d5b7-fd6a-4f97-87d0-3496d40e3967 tempest-AttachVolumeNegativeTest-376301777 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-574258552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=52935d67-1254-4ae3-810b-7b1ffa098955,launched_at=2023-04-14T03:30:38Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='3b689b65111045168cf21c51bf1274f2',provider_auth='CHAP AENZapny LRAtFfr5zga6l1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:30:37Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:30:45Z,use_quota=True,user_id='c1390cde350341c3ac0275e429146cf8',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:30:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-54d6d9e9-cd19-4390-9707-985a9c5dac9b req-f7e6d5b7-fd6a-4f97-87d0-3496d40e3967 tempest-AttachVolumeNegativeTest-376301777 None] detach volume v_52935d67-1254-4ae3-810b-7b1ffa098955 from target iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:30:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-54d6d9e9-cd19-4390-9707-985a9c5dac9b req-f7e6d5b7-fd6a-4f97-87d0-3496d40e3967 tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955/luns/v_52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:30:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-54d6d9e9-cd19-4390-9707-985a9c5dac9b req-f7e6d5b7-fd6a-4f97-87d0-3496d40e3967 tempest-AttachVolumeNegativeTest-376301777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955/luns/v_52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:30:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-54d6d9e9-cd19-4390-9707-985a9c5dac9b req-f7e6d5b7-fd6a-4f97-87d0-3496d40e3967 tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955/luns/v_52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:30:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-54d6d9e9-cd19-4390-9707-985a9c5dac9b req-f7e6d5b7-fd6a-4f97-87d0-3496d40e3967 tempest-AttachVolumeNegativeTest-376301777 None] delete target: iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:30:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-54d6d9e9-cd19-4390-9707-985a9c5dac9b req-f7e6d5b7-fd6a-4f97-87d0-3496d40e3967 tempest-AttachVolumeNegativeTest-376301777 None] delete target iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:30:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-54d6d9e9-cd19-4390-9707-985a9c5dac9b req-f7e6d5b7-fd6a-4f97-87d0-3496d40e3967 tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:30:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-54d6d9e9-cd19-4390-9707-985a9c5dac9b req-f7e6d5b7-fd6a-4f97-87d0-3496d40e3967 tempest-AttachVolumeNegativeTest-376301777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:30:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-54d6d9e9-cd19-4390-9707-985a9c5dac9b req-f7e6d5b7-fd6a-4f97-87d0-3496d40e3967 tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:30:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-54d6d9e9-cd19-4390-9707-985a9c5dac9b req-f7e6d5b7-fd6a-4f97-87d0-3496d40e3967 tempest-AttachVolumeNegativeTest-376301777 None] target iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:31:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:31:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:31:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:31:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:31:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:31:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114265903104', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:31:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:31:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:31:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=23,cinder:UPDATE=9 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=25,cinder:DELETE=1,cinder:UPDATE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ef0b10a4-005e-4638-bb4d-733bf3741232 req-79f589f4-4be4-4334-ae7d-adb03bfdec73 tempest-AttachVolumeShelveTestJSON-1546459049 None] terminate connection for 206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:31:18 user cinder-volume[73403]: INFO cinder.volume.manager [req-ef0b10a4-005e-4638-bb4d-733bf3741232 req-79f589f4-4be4-4334-ae7d-adb03bfdec73 tempest-AttachVolumeShelveTestJSON-1546459049 None] Terminate volume connection completed successfully. Apr 14 03:31:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-ef0b10a4-005e-4638-bb4d-733bf3741232 req-79f589f4-4be4-4334-ae7d-adb03bfdec73 tempest-AttachVolumeShelveTestJSON-1546459049 None] Deleting attachment 2f84256b-41b3-4369-bf80-046385b17ed3. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:31:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ef0b10a4-005e-4638-bb4d-733bf3741232 req-79f589f4-4be4-4334-ae7d-adb03bfdec73 tempest-AttachVolumeShelveTestJSON-1546459049 None] remove_export for volume: 206ed030-e355-423f-a35a-3598ef189cce. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:31:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ef0b10a4-005e-4638-bb4d-733bf3741232 req-79f589f4-4be4-4334-ae7d-adb03bfdec73 tempest-AttachVolumeShelveTestJSON-1546459049 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:31:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ef0b10a4-005e-4638-bb4d-733bf3741232 req-79f589f4-4be4-4334-ae7d-adb03bfdec73 tempest-AttachVolumeShelveTestJSON-1546459049 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-157469382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=206ed030-e355-423f-a35a-3598ef189cce,launched_at=2023-04-14T03:27:33Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='7ed26668c2cb49c38d16ff728d38bef2',provider_auth='CHAP FkuMDwZI m0nJx3Lz7RivfX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:27:32Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T03:31:17Z,use_quota=True,user_id='f88237b825b24effad17900bbf645ab8',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:31:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ef0b10a4-005e-4638-bb4d-733bf3741232 req-79f589f4-4be4-4334-ae7d-adb03bfdec73 tempest-AttachVolumeShelveTestJSON-1546459049 None] detach volume v_206ed030-e355-423f-a35a-3598ef189cce from target iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:31:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ef0b10a4-005e-4638-bb4d-733bf3741232 req-79f589f4-4be4-4334-ae7d-adb03bfdec73 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce/luns/v_206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:31:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ef0b10a4-005e-4638-bb4d-733bf3741232 req-79f589f4-4be4-4334-ae7d-adb03bfdec73 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce/luns/v_206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:31:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ef0b10a4-005e-4638-bb4d-733bf3741232 req-79f589f4-4be4-4334-ae7d-adb03bfdec73 tempest-AttachVolumeShelveTestJSON-1546459049 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce/luns/v_206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:31:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ef0b10a4-005e-4638-bb4d-733bf3741232 req-79f589f4-4be4-4334-ae7d-adb03bfdec73 tempest-AttachVolumeShelveTestJSON-1546459049 None] delete target: iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:31:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ef0b10a4-005e-4638-bb4d-733bf3741232 req-79f589f4-4be4-4334-ae7d-adb03bfdec73 tempest-AttachVolumeShelveTestJSON-1546459049 None] delete target iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:31:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ef0b10a4-005e-4638-bb4d-733bf3741232 req-79f589f4-4be4-4334-ae7d-adb03bfdec73 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:31:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ef0b10a4-005e-4638-bb4d-733bf3741232 req-79f589f4-4be4-4334-ae7d-adb03bfdec73 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:31:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ef0b10a4-005e-4638-bb4d-733bf3741232 req-79f589f4-4be4-4334-ae7d-adb03bfdec73 tempest-AttachVolumeShelveTestJSON-1546459049 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:31:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ef0b10a4-005e-4638-bb4d-733bf3741232 req-79f589f4-4be4-4334-ae7d-adb03bfdec73 tempest-AttachVolumeShelveTestJSON-1546459049 None] target iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:31:42 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:42 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:31:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-68c71c38-ab0b-47e1-946a-3a4d134beef9 tempest-TestShelveInstance-1966208901 None] terminate connection for 3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:31:56 user cinder-volume[73403]: INFO cinder.volume.manager [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-68c71c38-ab0b-47e1-946a-3a4d134beef9 tempest-TestShelveInstance-1966208901 None] Terminate volume connection completed successfully. Apr 14 03:31:56 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-68c71c38-ab0b-47e1-946a-3a4d134beef9 tempest-TestShelveInstance-1966208901 None] Deleting attachment 007d4e50-5e3e-4810-9926-671483ce4061. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:31:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-68c71c38-ab0b-47e1-946a-3a4d134beef9 tempest-TestShelveInstance-1966208901 None] remove_export for volume: 3a8e1f1a-36b6-47b7-95f2-d31cd1b55808. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:31:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-68c71c38-ab0b-47e1-946a-3a4d134beef9 tempest-TestShelveInstance-1966208901 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:31:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-68c71c38-ab0b-47e1-946a-3a4d134beef9 tempest-TestShelveInstance-1966208901 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1037613746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3a8e1f1a-36b6-47b7-95f2-d31cd1b55808,launched_at=2023-04-14T03:26:18Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='1e0979cf1834435bb0007899da52e863',provider_auth='CHAP TcJSZhIU DzvfZV8Xkx4RG0',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:26:16Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T03:30:09Z,use_quota=True,user_id='61f477304a044148ade1c6acffd30712',volume_attachment=,volume_type=,volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:31:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-68c71c38-ab0b-47e1-946a-3a4d134beef9 tempest-TestShelveInstance-1966208901 None] detach volume v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 from target iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:31:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-68c71c38-ab0b-47e1-946a-3a4d134beef9 tempest-TestShelveInstance-1966208901 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/luns/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:31:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-68c71c38-ab0b-47e1-946a-3a4d134beef9 tempest-TestShelveInstance-1966208901 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/luns/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:31:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-68c71c38-ab0b-47e1-946a-3a4d134beef9 tempest-TestShelveInstance-1966208901 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/luns/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:31:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-68c71c38-ab0b-47e1-946a-3a4d134beef9 tempest-TestShelveInstance-1966208901 None] delete target: iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:31:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-68c71c38-ab0b-47e1-946a-3a4d134beef9 tempest-TestShelveInstance-1966208901 None] delete target iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:31:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-68c71c38-ab0b-47e1-946a-3a4d134beef9 tempest-TestShelveInstance-1966208901 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:31:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-68c71c38-ab0b-47e1-946a-3a4d134beef9 tempest-TestShelveInstance-1966208901 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-68c71c38-ab0b-47e1-946a-3a4d134beef9 tempest-TestShelveInstance-1966208901 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-68c71c38-ab0b-47e1-946a-3a4d134beef9 tempest-TestShelveInstance-1966208901 None] target iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 deleted {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.coordination [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Acquiring lock "cinder-3a8e1f1a-36b6-47b7-95f2-d31cd1b55808-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.coordination [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Lock "cinder-3a8e1f1a-36b6-47b7-95f2-d31cd1b55808-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] remove_export for volume: 3a8e1f1a-36b6-47b7-95f2-d31cd1b55808. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1037613746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3a8e1f1a-36b6-47b7-95f2-d31cd1b55808,launched_at=2023-04-14T03:26:18Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e0979cf1834435bb0007899da52e863',provider_auth='CHAP TcJSZhIU DzvfZV8Xkx4RG0',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:26:16Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:31:57Z,updated_at=2023-04-14T03:31:57Z,use_quota=True,user_id='61f477304a044148ade1c6acffd30712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] detach volume v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 from target iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/luns/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/luns/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/luns/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/luns/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] failed to remove resource iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 because of JDSS resource v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] delete target: iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] delete target iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] failed to remove resource iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 because of JDSS resource iqn.2010-10.org.openstack:3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] deleating volume v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] get snapshots for volume v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] get volume v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_482f938f-083c-4221-99f8-3320a80b8725@v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444186', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26128384', 'sharesmb': None, 'createtxg': '113949', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10234515528679256155', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10149888', 'logicalused': '26030080', 'compressratio': '2.58', 'rootcontext': 'none', 'default_scsi_id': '2dc21b29a29e6fd4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114265903104', 'san:volume_id': '2dc21b29a29e6fd422ee826c7c410dfc03a17449', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10149888', 'objsetid': '87191', 'name': 'v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10149888', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] delete snapshot v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 of volume v_482f938f-083c-4221-99f8-3320a80b8725 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:31:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:31:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_482f938f-083c-4221-99f8-3320a80b8725/snapshots/v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:31:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] snapshot v_3a8e1f1a-36b6-47b7-95f2-d31cd1b55808 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:31:59 user cinder-volume[73403]: DEBUG cinder.quota [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Created reservations ['9c4290a5-797e-4eb2-8298-6a7d4eb02884', 'da698959-b9e4-4eb8-b204-d38bbbe5d7a8', '46c13e1f-c66e-4a76-a455-3c3b5ec28c71', 'dfe6f42f-83f1-4fdf-9bb0-2de611b8a00d'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:31:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:31:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:31:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:31:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276114432', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:32:00 user cinder-volume[73403]: DEBUG cinder.manager [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:32:00 user cinder-volume[73403]: INFO cinder.volume.manager [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Deleted volume successfully. Apr 14 03:32:00 user cinder-volume[73403]: DEBUG cinder.coordination [req-5cb79d5f-beb6-432f-99a5-2eeeb2a846cc req-fc829134-86f0-42ec-83ee-2cf46e21e040 tempest-TestShelveInstance-1966208901 None] Lock "cinder-3a8e1f1a-36b6-47b7-95f2-d31cd1b55808-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:32:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:32:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:32:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:32:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276114432', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:32:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:32:10 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=21,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=14,cinder:UPDATE=12,cinder:INSERT=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.coordination [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Acquiring lock "cinder-52935d67-1254-4ae3-810b-7b1ffa098955-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.coordination [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Lock "cinder-52935d67-1254-4ae3-810b-7b1ffa098955-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] remove_export for volume: 52935d67-1254-4ae3-810b-7b1ffa098955. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-574258552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=52935d67-1254-4ae3-810b-7b1ffa098955,launched_at=2023-04-14T03:30:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b689b65111045168cf21c51bf1274f2',provider_auth='CHAP AENZapny LRAtFfr5zga6l1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:30:37Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:32:26Z,updated_at=2023-04-14T03:32:26Z,use_quota=True,user_id='c1390cde350341c3ac0275e429146cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] detach volume v_52935d67-1254-4ae3-810b-7b1ffa098955 from target iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955/luns/v_52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955/luns/v_52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955/luns/v_52935d67-1254-4ae3-810b-7b1ffa098955'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955/luns/v_52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] failed to remove resource iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 because of JDSS resource v_52935d67-1254-4ae3-810b-7b1ffa098955 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] delete target: iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] delete target iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] failed to remove resource iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 because of JDSS resource iqn.2010-10.org.openstack:52935d67-1254-4ae3-810b-7b1ffa098955 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] deleating volume v_52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] get snapshots for volume v_52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_52935d67-1254-4ae3-810b-7b1ffa098955/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_52935d67-1254-4ae3-810b-7b1ffa098955/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_52935d67-1254-4ae3-810b-7b1ffa098955/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] get volume v_52935d67-1254-4ae3-810b-7b1ffa098955 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_52935d67-1254-4ae3-810b-7b1ffa098955', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444446', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114066', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3287789653764790959', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bb5db13042f20413', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276126720', 'san:volume_id': 'bb5db13042f20413ad39efb8995b141d141c6cc7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85365', 'name': 'v_52935d67-1254-4ae3-810b-7b1ffa098955', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] delete volume:v_52935d67-1254-4ae3-810b-7b1ffa098955 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_52935d67-1254-4ae3-810b-7b1ffa098955 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] volume v_52935d67-1254-4ae3-810b-7b1ffa098955 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:32:28 user cinder-volume[73403]: DEBUG cinder.quota [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Created reservations ['e12e74dd-e263-49ba-91f5-7c8716ca12af', '7e96105f-c710-4ea0-bec6-ca89d4874768', '46248124-5602-4f7f-948a-f455d0023ca4', '14c26462-6453-4dab-ad7b-71e39dd608c7'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:32:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:32:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:32:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276196352', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.manager [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:32:29 user cinder-volume[73403]: INFO cinder.volume.manager [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Deleted volume successfully. Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.coordination [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Acquiring lock "cinder-7ef98f79-a820-44e4-bde2-010a709dc93c-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.coordination [None req-9061368a-e9e7-4035-b90d-d2edc65e782f tempest-AttachVolumeNegativeTest-376301777 None] Lock "cinder-52935d67-1254-4ae3-810b-7b1ffa098955-delete_volume" released by "delete_volume" :: held 3.358s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.coordination [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Lock "cinder-7ef98f79-a820-44e4-bde2-010a709dc93c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] remove_export for volume: 7ef98f79-a820-44e4-bde2-010a709dc93c. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1026595092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7ef98f79-a820-44e4-bde2-010a709dc93c,launched_at=2023-04-14T03:26:50Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b689b65111045168cf21c51bf1274f2',provider_auth='CHAP EyFqhPUm qnD1vze56COdIM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:26:49Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:32:29Z,updated_at=2023-04-14T03:32:29Z,use_quota=True,user_id='c1390cde350341c3ac0275e429146cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] detach volume v_7ef98f79-a820-44e4-bde2-010a709dc93c from target iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c/luns/v_7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c/luns/v_7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c/luns/v_7ef98f79-a820-44e4-bde2-010a709dc93c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c/luns/v_7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] failed to remove resource iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c because of JDSS resource v_7ef98f79-a820-44e4-bde2-010a709dc93c DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] delete target: iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] delete target iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] failed to remove resource iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c because of JDSS resource iqn.2010-10.org.openstack:7ef98f79-a820-44e4-bde2-010a709dc93c DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] deleating volume v_7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] get snapshots for volume v_7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7ef98f79-a820-44e4-bde2-010a709dc93c/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7ef98f79-a820-44e4-bde2-010a709dc93c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7ef98f79-a820-44e4-bde2-010a709dc93c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] get volume v_7ef98f79-a820-44e4-bde2-010a709dc93c info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:32:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7ef98f79-a820-44e4-bde2-010a709dc93c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444218', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113963', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4685113491696428080', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e2957390eb4a045d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276196352', 'san:volume_id': 'e2957390eb4a045d43126d2e55885764c5081bae', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '85487', 'name': 'v_7ef98f79-a820-44e4-bde2-010a709dc93c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] delete volume:v_7ef98f79-a820-44e4-bde2-010a709dc93c recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:32:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7ef98f79-a820-44e4-bde2-010a709dc93c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] volume v_7ef98f79-a820-44e4-bde2-010a709dc93c deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:32:31 user cinder-volume[73403]: DEBUG cinder.quota [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Created reservations ['6b86599c-1b7e-4871-b8af-daf631453b28', '1b53b2e0-a3e8-448d-8f97-b6ae1ebc1abb', 'c4d6f282-78c5-46f7-8e1d-69b0b4f84d79', '53c2fb96-9706-498c-a587-433e1c234755'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:32:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:32:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:32:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276278272', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:32:32 user cinder-volume[73403]: DEBUG cinder.manager [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:32:32 user cinder-volume[73403]: INFO cinder.volume.manager [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Deleted volume successfully. Apr 14 03:32:32 user cinder-volume[73403]: DEBUG cinder.coordination [None req-9e42df3f-73d8-4694-885c-3136235487f7 tempest-AttachVolumeNegativeTest-376301777 None] Lock "cinder-7ef98f79-a820-44e4-bde2-010a709dc93c-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:32:32 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Acquiring lock "cinder-c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Lock "cinder-c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] remove_export for volume: c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-656303765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36,launched_at=2023-04-14T03:20:19Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b689b65111045168cf21c51bf1274f2',provider_auth='CHAP YIukGbUA SDA7qBrREfcxMy',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:20:18Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:32:33Z,updated_at=2023-04-14T03:32:33Z,use_quota=True,user_id='c1390cde350341c3ac0275e429146cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] detach volume v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 from target iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36/luns/v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36/luns/v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36/luns/v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36/luns/v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] failed to remove resource iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 because of JDSS resource v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] delete target: iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] delete target iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] failed to remove resource iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 because of JDSS resource iqn.2010-10.org.openstack:c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] deleating volume v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] get snapshots for volume v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] get volume v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681443827', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113843', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11953117503909274552', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1da6e20ad5d00e5e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276278272', 'san:volume_id': '1da6e20ad5d00e5e8be8fef895a672e55095bfaf', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86385', 'name': 'v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] delete volume:v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] volume v_c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:32:35 user cinder-volume[73403]: DEBUG cinder.quota [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Created reservations ['f548928a-1204-4ef6-9350-a0422e8cfcbf', '5c4acc9d-1e14-43bf-a08c-7d3dc3d8e0bb', 'e9d4ca33-e526-4e6c-9522-2b8d2470150f', '9a877bcb-258d-4268-a254-411d13a610db'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:32:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:32:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:32:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276372480', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:32:36 user cinder-volume[73403]: DEBUG cinder.manager [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:32:36 user cinder-volume[73403]: INFO cinder.volume.manager [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Deleted volume successfully. Apr 14 03:32:36 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b97370ed-ea4e-4189-a52c-e638e07c4fdd tempest-AttachVolumeNegativeTest-376301777 None] Lock "cinder-c2c4c1de-825b-42bd-a2a1-c7ed4e4eba36-delete_volume" released by "delete_volume" :: held 3.202s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:32:42 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=42,cinder:UPDATE=20,cinder:INSERT=8,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:42 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:32:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Flow 'volume_create_manager' (f0052fd6-e7ac-4aad-9463-08c62676b59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:32:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef7b9e6-b59b-4345-9216-7ac5c536550a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:32:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef7b9e6-b59b-4345-9216-7ac5c536550a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-906870419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ea118c81-6cec-46bc-a213-0fc93ab6eb9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9728bf5d6de438a88dce981b1969a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:32:42Z,use_quota=True,user_id='1bfdb59bfab64e97a7bcd802b0875586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:32:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d275239-e4f8-49e6-9e90-59ab5d995992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:32:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d275239-e4f8-49e6-9e90-59ab5d995992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:32:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b0baef-0213-48e2-80f4-022356c95664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:32:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b0baef-0213-48e2-80f4-022356c95664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea118c81-6cec-46bc-a213-0fc93ab6eb9c', 'volume_name': 'volume-ea118c81-6cec-46bc-a213-0fc93ab6eb9c', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:32:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd97295-7a66-40d8-8488-d21a2a2653ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:32:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd97295-7a66-40d8-8488-d21a2a2653ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:32:42 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4c4505-39fa-4454-9525-aa7059f5807a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:32:42 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Volume ea118c81-6cec-46bc-a213-0fc93ab6eb9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea118c81-6cec-46bc-a213-0fc93ab6eb9c', 'volume_size': 1} Apr 14 03:32:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] creating volume v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:32:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] create volume {'name': 'v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:32:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c', 'is_clone': False, 'name': 'v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4c4505-39fa-4454-9525-aa7059f5807a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea118c81-6cec-46bc-a213-0fc93ab6eb9c', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:32:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313010c8-4b9e-4bee-af7e-36be5bdf08c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:32:43 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Volume volume-ea118c81-6cec-46bc-a213-0fc93ab6eb9c (ea118c81-6cec-46bc-a213-0fc93ab6eb9c): created successfully Apr 14 03:32:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313010c8-4b9e-4bee-af7e-36be5bdf08c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:32:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Flow 'volume_create_manager' (f0052fd6-e7ac-4aad-9463-08c62676b59e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:32:43 user cinder-volume[73403]: INFO cinder.volume.manager [None req-b4c3e647-20c5-4932-bd00-454d4f686ddd tempest-AbsoluteLimitsTests-675479935 None] Created volume successfully. Apr 14 03:32:44 user cinder-volume[73403]: DEBUG cinder.coordination [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Acquiring lock "cinder-ea118c81-6cec-46bc-a213-0fc93ab6eb9c-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:32:44 user cinder-volume[73403]: DEBUG cinder.coordination [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Lock "cinder-ea118c81-6cec-46bc-a213-0fc93ab6eb9c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:32:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] remove_export for volume: ea118c81-6cec-46bc-a213-0fc93ab6eb9c. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:32:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:32:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-906870419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ea118c81-6cec-46bc-a213-0fc93ab6eb9c,launched_at=2023-04-14T03:32:43Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9728bf5d6de438a88dce981b1969a0f',provider_auth='CHAP XKSaOYZw oJLvgMDdU2IVar',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea118c81-6cec-46bc-a213-0fc93ab6eb9c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:32:42Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:32:45Z,updated_at=2023-04-14T03:32:45Z,use_quota=True,user_id='1bfdb59bfab64e97a7bcd802b0875586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:ea118c81-6cec-46bc-a213-0fc93ab6eb9c. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:32:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] detach volume v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c from target iqn.2010-10.org.openstack:ea118c81-6cec-46bc-a213-0fc93ab6eb9c {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:32:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ea118c81-6cec-46bc-a213-0fc93ab6eb9c/luns/v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ea118c81-6cec-46bc-a213-0fc93ab6eb9c/luns/v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ea118c81-6cec-46bc-a213-0fc93ab6eb9c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ea118c81-6cec-46bc-a213-0fc93ab6eb9c/luns/v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ea118c81-6cec-46bc-a213-0fc93ab6eb9c/luns/v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] failed to remove resource iqn.2010-10.org.openstack:ea118c81-6cec-46bc-a213-0fc93ab6eb9c because of JDSS resource v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:32:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] delete target: iqn.2010-10.org.openstack:ea118c81-6cec-46bc-a213-0fc93ab6eb9c {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:32:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] delete target iqn.2010-10.org.openstack:ea118c81-6cec-46bc-a213-0fc93ab6eb9c {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:32:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ea118c81-6cec-46bc-a213-0fc93ab6eb9c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ea118c81-6cec-46bc-a213-0fc93ab6eb9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ea118c81-6cec-46bc-a213-0fc93ab6eb9c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ea118c81-6cec-46bc-a213-0fc93ab6eb9c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ea118c81-6cec-46bc-a213-0fc93ab6eb9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] failed to remove resource iqn.2010-10.org.openstack:ea118c81-6cec-46bc-a213-0fc93ab6eb9c because of JDSS resource iqn.2010-10.org.openstack:ea118c81-6cec-46bc-a213-0fc93ab6eb9c DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:32:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] deleating volume v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:32:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] get snapshots for volume v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:32:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] get volume v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:32:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444571', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114103', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16933823968171502354', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bbbec84bf451a5d7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276290560', 'san:volume_id': 'bbbec84bf451a5d7e1c1aad6b512842a9381a441', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87557', 'name': 'v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] delete volume:v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:32:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] volume v_ea118c81-6cec-46bc-a213-0fc93ab6eb9c deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:32:46 user cinder-volume[73403]: DEBUG cinder.quota [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Created reservations ['adb8a122-64e6-4fe3-bc6a-8622743e2a0d', '77032492-4b44-4e0d-b031-8f06201c3c02', '01761930-689d-44df-adf5-2adcec44c9f7', 'e34a5d84-4917-405f-95b2-21a5001e839c'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:32:46 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=55,cinder:UPDATE=38,cinder:INSERT=6,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:32:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:32:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:32:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276372480', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:32:47 user cinder-volume[73403]: DEBUG cinder.manager [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:32:47 user cinder-volume[73403]: INFO cinder.volume.manager [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Deleted volume successfully. Apr 14 03:32:47 user cinder-volume[73403]: DEBUG cinder.coordination [None req-eae607e5-4262-436a-a43a-2c9e77ca86a3 tempest-AbsoluteLimitsTests-675479935 None] Lock "cinder-ea118c81-6cec-46bc-a213-0fc93ab6eb9c-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:32:51 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:32:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Flow 'volume_create_manager' (edc444ed-30fe-4e26-b5e0-32a166f3a8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:32:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9f0b2e-659f-4f5d-b454-e0417b5cb2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:32:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9f0b2e-659f-4f5d-b454-e0417b5cb2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-469326605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6032a1ef-a72a-44e7-8cba-e9c0a9e9a251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a80c10c1e940a58efa6af860e432ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:32:52Z,use_quota=True,user_id='afd1415f96a949c9bbe3516fd9930b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:32:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30f2347-3aa1-4c47-b4a5-2b1614cd3974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:32:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30f2347-3aa1-4c47-b4a5-2b1614cd3974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:32:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f792d91-ffb5-4dac-a015-b2163ca61908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:32:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f792d91-ffb5-4dac-a015-b2163ca61908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6032a1ef-a72a-44e7-8cba-e9c0a9e9a251', 'volume_name': 'volume-6032a1ef-a72a-44e7-8cba-e9c0a9e9a251', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:32:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7017798e-74bf-4b3d-b1eb-bfc1d9f3f2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:32:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7017798e-74bf-4b3d-b1eb-bfc1d9f3f2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:32:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66ade71d-6818-48b1-ab10-0607e210d6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:32:51 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Volume 6032a1ef-a72a-44e7-8cba-e9c0a9e9a251: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6032a1ef-a72a-44e7-8cba-e9c0a9e9a251', 'volume_size': 1} Apr 14 03:32:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] creating volume v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:32:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] create volume {'name': 'v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:32:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251', 'is_clone': False, 'name': 'v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66ade71d-6818-48b1-ab10-0607e210d6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6032a1ef-a72a-44e7-8cba-e9c0a9e9a251', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:32:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8233de09-3f41-4051-86da-97f4d1a9c11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:32:52 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Volume volume-6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 (6032a1ef-a72a-44e7-8cba-e9c0a9e9a251): created successfully Apr 14 03:32:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8233de09-3f41-4051-86da-97f4d1a9c11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:32:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Flow 'volume_create_manager' (edc444ed-30fe-4e26-b5e0-32a166f3a8f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:32:52 user cinder-volume[73403]: INFO cinder.volume.manager [None req-caf8e0ca-4d47-4001-99bd-cdfff13bffb4 tempest-VolumesTransfersV357Test-294836860 None] Created volume successfully. Apr 14 03:32:54 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8f02d731-0400-4e6d-83f0-444872376531 tempest-VolumesTransfersV357Test-595927146 None] Transfer volume completed successfully. Apr 14 03:32:54 user cinder-volume[73403]: DEBUG cinder.coordination [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Acquiring lock "cinder-6032a1ef-a72a-44e7-8cba-e9c0a9e9a251-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:32:54 user cinder-volume[73403]: DEBUG cinder.coordination [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Lock "cinder-6032a1ef-a72a-44e7-8cba-e9c0a9e9a251-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:32:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] remove_export for volume: 6032a1ef-a72a-44e7-8cba-e9c0a9e9a251. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:32:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:32:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-469326605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6032a1ef-a72a-44e7-8cba-e9c0a9e9a251,launched_at=2023-04-14T03:32:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39b054401a0476da415c614b3f25b42',provider_auth='CHAP iBWmqjRU iwFh2yTf8t1mZC',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:32:52Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:32:55Z,updated_at=2023-04-14T03:32:55Z,use_quota=True,user_id='b7056805e21f4938917cd2bd0fa03c24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:6032a1ef-a72a-44e7-8cba-e9c0a9e9a251. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:32:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] detach volume v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 from target iqn.2010-10.org.openstack:6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:32:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6032a1ef-a72a-44e7-8cba-e9c0a9e9a251/luns/v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6032a1ef-a72a-44e7-8cba-e9c0a9e9a251/luns/v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6032a1ef-a72a-44e7-8cba-e9c0a9e9a251/luns/v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6032a1ef-a72a-44e7-8cba-e9c0a9e9a251/luns/v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] failed to remove resource iqn.2010-10.org.openstack:6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 because of JDSS resource v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:32:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] delete target: iqn.2010-10.org.openstack:6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:32:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] delete target iqn.2010-10.org.openstack:6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:32:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6032a1ef-a72a-44e7-8cba-e9c0a9e9a251'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] failed to remove resource iqn.2010-10.org.openstack:6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 because of JDSS resource iqn.2010-10.org.openstack:6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:32:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] deleating volume v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:32:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] get snapshots for volume v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:32:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] get volume v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:32:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444581', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114109', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2464662925921111043', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '843cf14f3812dff2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276278272', 'san:volume_id': '843cf14f3812dff239b672f504afcdc83cce888c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86850', 'name': 'v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] delete volume:v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:32:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] volume v_6032a1ef-a72a-44e7-8cba-e9c0a9e9a251 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:32:57 user cinder-volume[73403]: DEBUG cinder.quota [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Created reservations ['edba5435-2b15-4b43-a12f-e0b4fd6bc8c8', '22363a17-9b0e-479d-a582-7df676a48c56', '6661d68e-124e-4335-a679-79fd537d084c', '2f9f91da-534b-4835-ac1f-97dcc513a02c'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:32:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:32:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:32:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276360192', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:32:58 user cinder-volume[73403]: DEBUG cinder.manager [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:32:58 user cinder-volume[73403]: INFO cinder.volume.manager [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Deleted volume successfully. Apr 14 03:32:58 user cinder-volume[73403]: DEBUG cinder.coordination [None req-06668e7c-f5ce-4b62-94bd-c3a56ef2fb9e tempest-VolumesTransfersV357Test-1180342227 None] Lock "cinder-6032a1ef-a72a-44e7-8cba-e9c0a9e9a251-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:32:58 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:32:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Flow 'volume_create_manager' (5d0e60fd-e48c-4add-ac67-20a88c1a66e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:32:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b6841f-2179-4e8d-96b3-a2bd7455c1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:32:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b6841f-2179-4e8d-96b3-a2bd7455c1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1260444415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f00f43e2-c26e-4145-bf14-9c112b0ad738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a80c10c1e940a58efa6af860e432ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:32:58Z,use_quota=True,user_id='afd1415f96a949c9bbe3516fd9930b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:32:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f839e38-97d1-414d-8d53-055108d9a734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:32:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f839e38-97d1-414d-8d53-055108d9a734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:32:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6986497a-c074-441f-841f-9c840647180d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:32:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6986497a-c074-441f-841f-9c840647180d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f00f43e2-c26e-4145-bf14-9c112b0ad738', 'volume_name': 'volume-f00f43e2-c26e-4145-bf14-9c112b0ad738', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:32:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f3e19c-288f-4475-b237-289609ba8f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:32:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f3e19c-288f-4475-b237-289609ba8f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:32:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c35364-094e-423a-914c-4ffda9ddc354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:32:58 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Volume f00f43e2-c26e-4145-bf14-9c112b0ad738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f00f43e2-c26e-4145-bf14-9c112b0ad738', 'volume_size': 1} Apr 14 03:32:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] creating volume v_f00f43e2-c26e-4145-bf14-9c112b0ad738. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:32:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] create volume {'name': 'v_f00f43e2-c26e-4145-bf14-9c112b0ad738', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:32:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:32:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:32:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_f00f43e2-c26e-4145-bf14-9c112b0ad738', 'is_clone': False, 'name': 'v_f00f43e2-c26e-4145-bf14-9c112b0ad738'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:32:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c35364-094e-423a-914c-4ffda9ddc354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f00f43e2-c26e-4145-bf14-9c112b0ad738', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:32:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1101fc-f66d-48a7-8a14-446ddfd9c710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:32:59 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Volume volume-f00f43e2-c26e-4145-bf14-9c112b0ad738 (f00f43e2-c26e-4145-bf14-9c112b0ad738): created successfully Apr 14 03:32:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1101fc-f66d-48a7-8a14-446ddfd9c710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:32:59 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Flow 'volume_create_manager' (5d0e60fd-e48c-4add-ac67-20a88c1a66e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:32:59 user cinder-volume[73403]: INFO cinder.volume.manager [None req-acbd703d-3395-4cb7-8138-f77815c2cdda tempest-VolumesTransfersV357Test-294836860 None] Created volume successfully. Apr 14 03:33:00 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Acquiring lock "cinder-f00f43e2-c26e-4145-bf14-9c112b0ad738-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:33:00 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Lock "cinder-f00f43e2-c26e-4145-bf14-9c112b0ad738-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:33:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] remove_export for volume: f00f43e2-c26e-4145-bf14-9c112b0ad738. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:33:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:33:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1260444415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f00f43e2-c26e-4145-bf14-9c112b0ad738,launched_at=2023-04-14T03:32:59Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a80c10c1e940a58efa6af860e432ba',provider_auth='CHAP DIVWSKoe OdGFNfoh5klJEq',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00f43e2-c26e-4145-bf14-9c112b0ad738 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:32:58Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:33:01Z,updated_at=2023-04-14T03:33:01Z,use_quota=True,user_id='afd1415f96a949c9bbe3516fd9930b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:f00f43e2-c26e-4145-bf14-9c112b0ad738. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:33:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] detach volume v_f00f43e2-c26e-4145-bf14-9c112b0ad738 from target iqn.2010-10.org.openstack:f00f43e2-c26e-4145-bf14-9c112b0ad738 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:33:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f00f43e2-c26e-4145-bf14-9c112b0ad738/luns/v_f00f43e2-c26e-4145-bf14-9c112b0ad738 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f00f43e2-c26e-4145-bf14-9c112b0ad738/luns/v_f00f43e2-c26e-4145-bf14-9c112b0ad738 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f00f43e2-c26e-4145-bf14-9c112b0ad738 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f00f43e2-c26e-4145-bf14-9c112b0ad738/luns/v_f00f43e2-c26e-4145-bf14-9c112b0ad738'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f00f43e2-c26e-4145-bf14-9c112b0ad738/luns/v_f00f43e2-c26e-4145-bf14-9c112b0ad738 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] failed to remove resource iqn.2010-10.org.openstack:f00f43e2-c26e-4145-bf14-9c112b0ad738 because of JDSS resource v_f00f43e2-c26e-4145-bf14-9c112b0ad738 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:33:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] delete target: iqn.2010-10.org.openstack:f00f43e2-c26e-4145-bf14-9c112b0ad738 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:33:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] delete target iqn.2010-10.org.openstack:f00f43e2-c26e-4145-bf14-9c112b0ad738 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:33:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f00f43e2-c26e-4145-bf14-9c112b0ad738 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f00f43e2-c26e-4145-bf14-9c112b0ad738 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f00f43e2-c26e-4145-bf14-9c112b0ad738 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f00f43e2-c26e-4145-bf14-9c112b0ad738'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f00f43e2-c26e-4145-bf14-9c112b0ad738 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] failed to remove resource iqn.2010-10.org.openstack:f00f43e2-c26e-4145-bf14-9c112b0ad738 because of JDSS resource iqn.2010-10.org.openstack:f00f43e2-c26e-4145-bf14-9c112b0ad738 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:33:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] deleating volume v_f00f43e2-c26e-4145-bf14-9c112b0ad738 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:33:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] get snapshots for volume v_f00f43e2-c26e-4145-bf14-9c112b0ad738 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:33:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f00f43e2-c26e-4145-bf14-9c112b0ad738/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f00f43e2-c26e-4145-bf14-9c112b0ad738/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f00f43e2-c26e-4145-bf14-9c112b0ad738/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] get volume v_f00f43e2-c26e-4145-bf14-9c112b0ad738 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:33:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f00f43e2-c26e-4145-bf14-9c112b0ad738 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f00f43e2-c26e-4145-bf14-9c112b0ad738 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f00f43e2-c26e-4145-bf14-9c112b0ad738', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444588', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114114', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9108634655138329102', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7027eaeffd09910a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276265984', 'san:volume_id': '7027eaeffd09910a91913790f3fd58612354864b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86861', 'name': 'v_f00f43e2-c26e-4145-bf14-9c112b0ad738', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f00f43e2-c26e-4145-bf14-9c112b0ad738 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] delete volume:v_f00f43e2-c26e-4145-bf14-9c112b0ad738 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:33:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f00f43e2-c26e-4145-bf14-9c112b0ad738 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f00f43e2-c26e-4145-bf14-9c112b0ad738 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f00f43e2-c26e-4145-bf14-9c112b0ad738 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] volume v_f00f43e2-c26e-4145-bf14-9c112b0ad738 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:33:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:33:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:33:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:33:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:03 user cinder-volume[73403]: DEBUG cinder.quota [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Created reservations ['624aa8bb-c0b7-4ff8-b473-d30bbd2f1b79', '8f3d2fef-c6b0-4f1d-897f-936c614a99a3', 'e1d86867-84f9-4f05-ad11-626af1f086a9', '688f48c8-5924-472e-b197-5cf72c3dcec3'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:33:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:33:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:33:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276360192', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:33:03 user cinder-volume[73403]: DEBUG cinder.manager [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:33:03 user cinder-volume[73403]: INFO cinder.volume.manager [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Deleted volume successfully. Apr 14 03:33:03 user cinder-volume[73403]: DEBUG cinder.coordination [None req-7762cfcc-ee24-43aa-b4be-e0243579d184 tempest-VolumesTransfersV357Test-1180342227 None] Lock "cinder-f00f43e2-c26e-4145-bf14-9c112b0ad738-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:33:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276347904', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:33:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:33:07 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:33:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Flow 'volume_create_manager' (6920f741-125c-48b8-89ef-f96b7c451ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:33:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9b1391-ce69-4016-acca-5ed1017ccab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9b1391-ce69-4016-acca-5ed1017ccab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-693315103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0037010f-9bd2-4ed2-8c8f-71dc1de7806e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a418d76b384f51955aaffeabc15a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:33:08Z,use_quota=True,user_id='c0dee0638b0844859007a81ad700bbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b259c94a-c0f3-4a90-8232-690eb8662803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b259c94a-c0f3-4a90-8232-690eb8662803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ea811f-ec71-4c67-92e9-83d8f390b901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ea811f-ec71-4c67-92e9-83d8f390b901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0037010f-9bd2-4ed2-8c8f-71dc1de7806e', 'volume_name': 'volume-0037010f-9bd2-4ed2-8c8f-71dc1de7806e', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7877639b-1078-494a-952a-01b61d9d96a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7877639b-1078-494a-952a-01b61d9d96a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b35f4e7-99d1-4782-b062-fd80df21a23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:07 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Volume 0037010f-9bd2-4ed2-8c8f-71dc1de7806e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0037010f-9bd2-4ed2-8c8f-71dc1de7806e', 'volume_size': 1} Apr 14 03:33:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] creating volume v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:33:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] create volume {'name': 'v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:33:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e', 'is_clone': False, 'name': 'v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b35f4e7-99d1-4782-b062-fd80df21a23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0037010f-9bd2-4ed2-8c8f-71dc1de7806e', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04093eff-2cd2-4bab-a49b-4b018b92fb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:08 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Volume volume-0037010f-9bd2-4ed2-8c8f-71dc1de7806e (0037010f-9bd2-4ed2-8c8f-71dc1de7806e): created successfully Apr 14 03:33:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04093eff-2cd2-4bab-a49b-4b018b92fb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Flow 'volume_create_manager' (6920f741-125c-48b8-89ef-f96b7c451ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:33:08 user cinder-volume[73403]: INFO cinder.volume.manager [None req-31d27eb1-cd85-490b-aeab-224dc26c6506 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Created volume successfully. Apr 14 03:33:09 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=57,cinder:UPDATE=34,cinder:DELETE=2,cinder:INSERT=7 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:33:09 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:33:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Flow 'volume_create_manager' (904a24dc-f519-4cd9-80b8-c6d99b77f047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:33:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8303e8b-88f2-48d3-b58e-fbe052e24fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8303e8b-88f2-48d3-b58e-fbe052e24fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-589030899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b9fe6a79-88f2-4067-bb54-f0cd665b5992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a418d76b384f51955aaffeabc15a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:33:10Z,use_quota=True,user_id='c0dee0638b0844859007a81ad700bbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfffb5f5-b1c0-4a2d-a46c-7f3354c4d315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:09 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfffb5f5-b1c0-4a2d-a46c-7f3354c4d315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b52f7b-5b2e-46f0-84ed-56d47250e7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b52f7b-5b2e-46f0-84ed-56d47250e7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9fe6a79-88f2-4067-bb54-f0cd665b5992', 'volume_name': 'volume-b9fe6a79-88f2-4067-bb54-f0cd665b5992', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e310a77d-7eee-4c9b-9eb4-0e3a35076559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e310a77d-7eee-4c9b-9eb4-0e3a35076559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e69067-1f97-4f9b-a6bf-cb14e0e469a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:10 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Volume b9fe6a79-88f2-4067-bb54-f0cd665b5992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9fe6a79-88f2-4067-bb54-f0cd665b5992', 'volume_size': 1} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] creating volume v_b9fe6a79-88f2-4067-bb54-f0cd665b5992. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] create volume {'name': 'v_b9fe6a79-88f2-4067-bb54-f0cd665b5992', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Flow 'volume_create_manager' (f6ce11f0-a4ae-4344-a776-7cdf040a4901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38f952b-2353-4ea7-a8fb-175f8b470210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38f952b-2353-4ea7-a8fb-175f8b470210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-947622766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9ae8ed28-852d-4da8-9119-2388424a0c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a418d76b384f51955aaffeabc15a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:33:10Z,use_quota=True,user_id='c0dee0638b0844859007a81ad700bbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a3ab3f-7f34-4e31-bbf8-f116b68b6316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a3ab3f-7f34-4e31-bbf8-f116b68b6316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab3d07f-3f01-4ba2-8064-2daf3cbbbb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab3d07f-3f01-4ba2-8064-2daf3cbbbb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ae8ed28-852d-4da8-9119-2388424a0c19', 'volume_name': 'volume-9ae8ed28-852d-4da8-9119-2388424a0c19', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a5f14b-fd6e-487a-bceb-f047aeec6d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a5f14b-fd6e-487a-bceb-f047aeec6d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef98ec8-dc73-4df6-ac10-55bd87c61027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:10 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Volume 9ae8ed28-852d-4da8-9119-2388424a0c19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ae8ed28-852d-4da8-9119-2388424a0c19', 'volume_size': 1} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] creating volume v_9ae8ed28-852d-4da8-9119-2388424a0c19. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] create volume {'name': 'v_9ae8ed28-852d-4da8-9119-2388424a0c19', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Flow 'volume_create_manager' (b506efda-d50b-40d9-99a6-f2d1a1585122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e11df4d-c882-4a6d-bd64-8be27204f2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e11df4d-c882-4a6d-bd64-8be27204f2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-301723320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7e8ffa4f-be3b-4056-89bd-73aad0032496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a418d76b384f51955aaffeabc15a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:33:11Z,use_quota=True,user_id='c0dee0638b0844859007a81ad700bbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b98d8ebb-b6c1-432d-bb18-ab8163866978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b98d8ebb-b6c1-432d-bb18-ab8163866978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0831b6f1-c3ff-4c90-a9b8-f7574fedb6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0831b6f1-c3ff-4c90-a9b8-f7574fedb6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e8ffa4f-be3b-4056-89bd-73aad0032496', 'volume_name': 'volume-7e8ffa4f-be3b-4056-89bd-73aad0032496', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe56ca12-689e-4fee-b8fd-b505ccea2003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe56ca12-689e-4fee-b8fd-b505ccea2003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (838f620f-b8aa-4f18-9912-7d486f29949a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:10 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Volume 7e8ffa4f-be3b-4056-89bd-73aad0032496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e8ffa4f-be3b-4056-89bd-73aad0032496', 'volume_size': 1} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] creating volume v_7e8ffa4f-be3b-4056-89bd-73aad0032496. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] create volume {'name': 'v_7e8ffa4f-be3b-4056-89bd-73aad0032496', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Flow 'volume_create_manager' (6605a2e8-678e-4cdf-b24d-9568b1d1dc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344301ff-0936-43f0-b545-ed902455bd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344301ff-0936-43f0-b545-ed902455bd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1123715298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c0f7f486-b042-4905-9345-dac774b4aa69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a418d76b384f51955aaffeabc15a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:33:11Z,use_quota=True,user_id='c0dee0638b0844859007a81ad700bbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ab2b93-5f04-425e-8299-7fa7a0bb191b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ab2b93-5f04-425e-8299-7fa7a0bb191b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe9a138-9bf9-4370-8526-a80a2a24ff91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe9a138-9bf9-4370-8526-a80a2a24ff91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f7f486-b042-4905-9345-dac774b4aa69', 'volume_name': 'volume-c0f7f486-b042-4905-9345-dac774b4aa69', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf7659b-62fe-45a5-b9b8-691db9b2a3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf7659b-62fe-45a5-b9b8-691db9b2a3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0abc38-57cb-4c0d-99bd-8dca0e3ab02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:11 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Volume c0f7f486-b042-4905-9345-dac774b4aa69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f7f486-b042-4905-9345-dac774b4aa69', 'volume_size': 1} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] creating volume v_c0f7f486-b042-4905-9345-dac774b4aa69. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] create volume {'name': 'v_c0f7f486-b042-4905-9345-dac774b4aa69', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b9fe6a79-88f2-4067-bb54-f0cd665b5992', 'is_clone': False, 'name': 'v_b9fe6a79-88f2-4067-bb54-f0cd665b5992'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Flow 'volume_create_manager' (64369568-7315-4754-ac96-b962c57d769f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f0c7f18-0338-4e72-b718-1d345970002d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f0c7f18-0338-4e72-b718-1d345970002d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1701543539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=82c380be-09cb-4d75-8036-af0e22b2e735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a418d76b384f51955aaffeabc15a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:33:11Z,use_quota=True,user_id='c0dee0638b0844859007a81ad700bbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded82f96-d320-4938-a30e-c89ad7ca2ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded82f96-d320-4938-a30e-c89ad7ca2ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960d872f-9f95-4d4f-9771-24075896fbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960d872f-9f95-4d4f-9771-24075896fbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82c380be-09cb-4d75-8036-af0e22b2e735', 'volume_name': 'volume-82c380be-09cb-4d75-8036-af0e22b2e735', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21205940-e482-4eb9-93c2-19f642fad058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21205940-e482-4eb9-93c2-19f642fad058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5085ba91-e9d1-403e-bb1a-42336384669c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:11 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Volume 82c380be-09cb-4d75-8036-af0e22b2e735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82c380be-09cb-4d75-8036-af0e22b2e735', 'volume_size': 1} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] creating volume v_82c380be-09cb-4d75-8036-af0e22b2e735. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] create volume {'name': 'v_82c380be-09cb-4d75-8036-af0e22b2e735', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e69067-1f97-4f9b-a6bf-cb14e0e469a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9fe6a79-88f2-4067-bb54-f0cd665b5992', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecead766-c626-42f6-8d1b-3667bf667e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:11 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Volume volume-b9fe6a79-88f2-4067-bb54-f0cd665b5992 (b9fe6a79-88f2-4067-bb54-f0cd665b5992): created successfully Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecead766-c626-42f6-8d1b-3667bf667e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Flow 'volume_create_manager' (904a24dc-f519-4cd9-80b8-c6d99b77f047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:33:11 user cinder-volume[73403]: INFO cinder.volume.manager [None req-c5d0e13a-519c-48e0-92d2-b27c3c908562 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Created volume successfully. Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_7e8ffa4f-be3b-4056-89bd-73aad0032496', 'is_clone': False, 'name': 'v_7e8ffa4f-be3b-4056-89bd-73aad0032496'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (838f620f-b8aa-4f18-9912-7d486f29949a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e8ffa4f-be3b-4056-89bd-73aad0032496', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a962d9e-32d3-466f-aec7-6add10334720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=32,cinder:SELECT=60,cinder:DELETE=5,cinder:INSERT=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:33:11 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Volume volume-7e8ffa4f-be3b-4056-89bd-73aad0032496 (7e8ffa4f-be3b-4056-89bd-73aad0032496): created successfully Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a962d9e-32d3-466f-aec7-6add10334720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:11 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Flow 'volume_create_manager' (b506efda-d50b-40d9-99a6-f2d1a1585122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:33:11 user cinder-volume[73403]: INFO cinder.volume.manager [None req-3e66fa0c-0324-4a30-87e7-fd48351c27c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Created volume successfully. Apr 14 03:33:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9ae8ed28-852d-4da8-9119-2388424a0c19', 'is_clone': False, 'name': 'v_9ae8ed28-852d-4da8-9119-2388424a0c19'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c0f7f486-b042-4905-9345-dac774b4aa69', 'is_clone': False, 'name': 'v_c0f7f486-b042-4905-9345-dac774b4aa69'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef98ec8-dc73-4df6-ac10-55bd87c61027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ae8ed28-852d-4da8-9119-2388424a0c19', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e07ff1-e24d-4dd4-bfbc-e0852f047937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0abc38-57cb-4c0d-99bd-8dca0e3ab02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f7f486-b042-4905-9345-dac774b4aa69', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f9439f-f253-43a1-81d0-d5b7e7b20049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:12 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Volume volume-9ae8ed28-852d-4da8-9119-2388424a0c19 (9ae8ed28-852d-4da8-9119-2388424a0c19): created successfully Apr 14 03:33:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e07ff1-e24d-4dd4-bfbc-e0852f047937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Flow 'volume_create_manager' (f6ce11f0-a4ae-4344-a776-7cdf040a4901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:33:12 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Volume volume-c0f7f486-b042-4905-9345-dac774b4aa69 (c0f7f486-b042-4905-9345-dac774b4aa69): created successfully Apr 14 03:33:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f9439f-f253-43a1-81d0-d5b7e7b20049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:12 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Flow 'volume_create_manager' (6605a2e8-678e-4cdf-b24d-9568b1d1dc3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:33:12 user cinder-volume[73403]: INFO cinder.volume.manager [None req-8edd6203-755a-4f43-bc66-0ce8ce617970 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Created volume successfully. Apr 14 03:33:12 user cinder-volume[73403]: INFO cinder.volume.manager [None req-7d5dbd87-a0b3-4c93-be41-c2f15457462c tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Created volume successfully. Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_82c380be-09cb-4d75-8036-af0e22b2e735', 'is_clone': False, 'name': 'v_82c380be-09cb-4d75-8036-af0e22b2e735'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5085ba91-e9d1-403e-bb1a-42336384669c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82c380be-09cb-4d75-8036-af0e22b2e735', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74945c4c-18a9-4f20-b578-c59852c854bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:33:13 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Volume volume-82c380be-09cb-4d75-8036-af0e22b2e735 (82c380be-09cb-4d75-8036-af0e22b2e735): created successfully Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74945c4c-18a9-4f20-b578-c59852c854bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Flow 'volume_create_manager' (64369568-7315-4754-ac96-b962c57d769f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:33:13 user cinder-volume[73403]: INFO cinder.volume.manager [None req-3806effe-8cb9-48ac-9d71-915c0afc8f0d tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Created volume successfully. Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Acquiring lock "cinder-82c380be-09cb-4d75-8036-af0e22b2e735-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Lock "cinder-82c380be-09cb-4d75-8036-af0e22b2e735-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] remove_export for volume: 82c380be-09cb-4d75-8036-af0e22b2e735. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1701543539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=82c380be-09cb-4d75-8036-af0e22b2e735,launched_at=2023-04-14T03:33:13Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a418d76b384f51955aaffeabc15a4b',provider_auth='CHAP vzVmSyXI 8nyhlXA1SNYpeH',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c380be-09cb-4d75-8036-af0e22b2e735 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:33:11Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:33:13Z,updated_at=2023-04-14T03:33:13Z,use_quota=True,user_id='c0dee0638b0844859007a81ad700bbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:82c380be-09cb-4d75-8036-af0e22b2e735. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] detach volume v_82c380be-09cb-4d75-8036-af0e22b2e735 from target iqn.2010-10.org.openstack:82c380be-09cb-4d75-8036-af0e22b2e735 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82c380be-09cb-4d75-8036-af0e22b2e735/luns/v_82c380be-09cb-4d75-8036-af0e22b2e735 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82c380be-09cb-4d75-8036-af0e22b2e735/luns/v_82c380be-09cb-4d75-8036-af0e22b2e735 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:82c380be-09cb-4d75-8036-af0e22b2e735 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82c380be-09cb-4d75-8036-af0e22b2e735/luns/v_82c380be-09cb-4d75-8036-af0e22b2e735'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82c380be-09cb-4d75-8036-af0e22b2e735/luns/v_82c380be-09cb-4d75-8036-af0e22b2e735 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] failed to remove resource iqn.2010-10.org.openstack:82c380be-09cb-4d75-8036-af0e22b2e735 because of JDSS resource v_82c380be-09cb-4d75-8036-af0e22b2e735 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] delete target: iqn.2010-10.org.openstack:82c380be-09cb-4d75-8036-af0e22b2e735 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] delete target iqn.2010-10.org.openstack:82c380be-09cb-4d75-8036-af0e22b2e735 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82c380be-09cb-4d75-8036-af0e22b2e735 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82c380be-09cb-4d75-8036-af0e22b2e735 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:82c380be-09cb-4d75-8036-af0e22b2e735 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82c380be-09cb-4d75-8036-af0e22b2e735'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:82c380be-09cb-4d75-8036-af0e22b2e735 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] failed to remove resource iqn.2010-10.org.openstack:82c380be-09cb-4d75-8036-af0e22b2e735 because of JDSS resource iqn.2010-10.org.openstack:82c380be-09cb-4d75-8036-af0e22b2e735 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] deleating volume v_82c380be-09cb-4d75-8036-af0e22b2e735 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] get snapshots for volume v_82c380be-09cb-4d75-8036-af0e22b2e735 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82c380be-09cb-4d75-8036-af0e22b2e735/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82c380be-09cb-4d75-8036-af0e22b2e735/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82c380be-09cb-4d75-8036-af0e22b2e735/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] get volume v_82c380be-09cb-4d75-8036-af0e22b2e735 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82c380be-09cb-4d75-8036-af0e22b2e735 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82c380be-09cb-4d75-8036-af0e22b2e735 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_82c380be-09cb-4d75-8036-af0e22b2e735', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444601', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114140', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2652050509925581167', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd74c2a756df1bded', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275893248', 'san:volume_id': 'd74c2a756df1bdeda005b3df827be9e571f86e63', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86652', 'name': 'v_82c380be-09cb-4d75-8036-af0e22b2e735', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82c380be-09cb-4d75-8036-af0e22b2e735 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] delete volume:v_82c380be-09cb-4d75-8036-af0e22b2e735 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:33:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82c380be-09cb-4d75-8036-af0e22b2e735 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82c380be-09cb-4d75-8036-af0e22b2e735 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_82c380be-09cb-4d75-8036-af0e22b2e735 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] volume v_82c380be-09cb-4d75-8036-af0e22b2e735 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:33:15 user cinder-volume[73403]: DEBUG cinder.quota [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Created reservations ['33b95ab3-8d5b-48ef-9fdf-74b0a15ff004', 'f24be0be-e004-4c1c-b2c8-851473e332a8', 'db5f1883-07a1-491d-bafd-938f42788bf2', '2c9c4313-e3ab-4068-9831-2895dd5e26e7'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:33:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:33:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:33:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:15 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 200, 'error': None, 'data': {'available': '114275975168', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.manager [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:33:16 user cinder-volume[73403]: INFO cinder.volume.manager [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Deleted volume successfully. Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f20212d6-aabf-4aa0-96c3-f3092f81b3c2 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Lock "cinder-82c380be-09cb-4d75-8036-af0e22b2e735-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Acquiring lock "cinder-c0f7f486-b042-4905-9345-dac774b4aa69-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Lock "cinder-c0f7f486-b042-4905-9345-dac774b4aa69-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] remove_export for volume: c0f7f486-b042-4905-9345-dac774b4aa69. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1123715298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c0f7f486-b042-4905-9345-dac774b4aa69,launched_at=2023-04-14T03:33:12Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a418d76b384f51955aaffeabc15a4b',provider_auth='CHAP LBcGaEIx zJltYPfQ9HMDGX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0f7f486-b042-4905-9345-dac774b4aa69 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:33:11Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:33:17Z,updated_at=2023-04-14T03:33:17Z,use_quota=True,user_id='c0dee0638b0844859007a81ad700bbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:c0f7f486-b042-4905-9345-dac774b4aa69. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] detach volume v_c0f7f486-b042-4905-9345-dac774b4aa69 from target iqn.2010-10.org.openstack:c0f7f486-b042-4905-9345-dac774b4aa69 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c0f7f486-b042-4905-9345-dac774b4aa69/luns/v_c0f7f486-b042-4905-9345-dac774b4aa69 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c0f7f486-b042-4905-9345-dac774b4aa69/luns/v_c0f7f486-b042-4905-9345-dac774b4aa69 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c0f7f486-b042-4905-9345-dac774b4aa69 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c0f7f486-b042-4905-9345-dac774b4aa69/luns/v_c0f7f486-b042-4905-9345-dac774b4aa69'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c0f7f486-b042-4905-9345-dac774b4aa69/luns/v_c0f7f486-b042-4905-9345-dac774b4aa69 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] failed to remove resource iqn.2010-10.org.openstack:c0f7f486-b042-4905-9345-dac774b4aa69 because of JDSS resource v_c0f7f486-b042-4905-9345-dac774b4aa69 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] delete target: iqn.2010-10.org.openstack:c0f7f486-b042-4905-9345-dac774b4aa69 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] delete target iqn.2010-10.org.openstack:c0f7f486-b042-4905-9345-dac774b4aa69 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c0f7f486-b042-4905-9345-dac774b4aa69 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c0f7f486-b042-4905-9345-dac774b4aa69 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c0f7f486-b042-4905-9345-dac774b4aa69 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c0f7f486-b042-4905-9345-dac774b4aa69'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c0f7f486-b042-4905-9345-dac774b4aa69 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] failed to remove resource iqn.2010-10.org.openstack:c0f7f486-b042-4905-9345-dac774b4aa69 because of JDSS resource iqn.2010-10.org.openstack:c0f7f486-b042-4905-9345-dac774b4aa69 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] deleating volume v_c0f7f486-b042-4905-9345-dac774b4aa69 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] get snapshots for volume v_c0f7f486-b042-4905-9345-dac774b4aa69 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c0f7f486-b042-4905-9345-dac774b4aa69/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c0f7f486-b042-4905-9345-dac774b4aa69/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c0f7f486-b042-4905-9345-dac774b4aa69/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] get volume v_c0f7f486-b042-4905-9345-dac774b4aa69 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:33:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c0f7f486-b042-4905-9345-dac774b4aa69 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c0f7f486-b042-4905-9345-dac774b4aa69 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c0f7f486-b042-4905-9345-dac774b4aa69', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444600', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114134', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12159732429816344515', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8e3444f9d29f12a0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275975168', 'san:volume_id': '8e3444f9d29f12a0de6ea22d0d226392aa3b2fcd', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86641', 'name': 'v_c0f7f486-b042-4905-9345-dac774b4aa69', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c0f7f486-b042-4905-9345-dac774b4aa69 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] delete volume:v_c0f7f486-b042-4905-9345-dac774b4aa69 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:33:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c0f7f486-b042-4905-9345-dac774b4aa69 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:17 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c0f7f486-b042-4905-9345-dac774b4aa69 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c0f7f486-b042-4905-9345-dac774b4aa69 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] volume v_c0f7f486-b042-4905-9345-dac774b4aa69 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:33:19 user cinder-volume[73403]: DEBUG cinder.quota [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Created reservations ['d5605975-59bb-4473-b036-79ab255ab872', '224eadc9-164e-4b10-a8f2-d705eda76983', '1186e538-24fc-4693-b5a5-c28204d0e37c', '02ffb91a-20a6-4f38-8eef-45ce09a897f4'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:33:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:33:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:33:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:19 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276057088', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.manager [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:33:20 user cinder-volume[73403]: INFO cinder.volume.manager [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Deleted volume successfully. Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b9be6185-45f5-4bb6-b9ad-4b155a4bfa54 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Lock "cinder-c0f7f486-b042-4905-9345-dac774b4aa69-delete_volume" released by "delete_volume" :: held 3.293s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Acquiring lock "cinder-7e8ffa4f-be3b-4056-89bd-73aad0032496-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Lock "cinder-7e8ffa4f-be3b-4056-89bd-73aad0032496-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] remove_export for volume: 7e8ffa4f-be3b-4056-89bd-73aad0032496. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-301723320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7e8ffa4f-be3b-4056-89bd-73aad0032496,launched_at=2023-04-14T03:33:12Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a418d76b384f51955aaffeabc15a4b',provider_auth='CHAP bEFBPZUN qdrgI25aOXYbTh',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8ffa4f-be3b-4056-89bd-73aad0032496 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:33:11Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:33:20Z,updated_at=2023-04-14T03:33:20Z,use_quota=True,user_id='c0dee0638b0844859007a81ad700bbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:7e8ffa4f-be3b-4056-89bd-73aad0032496. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] detach volume v_7e8ffa4f-be3b-4056-89bd-73aad0032496 from target iqn.2010-10.org.openstack:7e8ffa4f-be3b-4056-89bd-73aad0032496 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e8ffa4f-be3b-4056-89bd-73aad0032496/luns/v_7e8ffa4f-be3b-4056-89bd-73aad0032496 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e8ffa4f-be3b-4056-89bd-73aad0032496/luns/v_7e8ffa4f-be3b-4056-89bd-73aad0032496 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7e8ffa4f-be3b-4056-89bd-73aad0032496 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e8ffa4f-be3b-4056-89bd-73aad0032496/luns/v_7e8ffa4f-be3b-4056-89bd-73aad0032496'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e8ffa4f-be3b-4056-89bd-73aad0032496/luns/v_7e8ffa4f-be3b-4056-89bd-73aad0032496 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] failed to remove resource iqn.2010-10.org.openstack:7e8ffa4f-be3b-4056-89bd-73aad0032496 because of JDSS resource v_7e8ffa4f-be3b-4056-89bd-73aad0032496 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] delete target: iqn.2010-10.org.openstack:7e8ffa4f-be3b-4056-89bd-73aad0032496 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] delete target iqn.2010-10.org.openstack:7e8ffa4f-be3b-4056-89bd-73aad0032496 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e8ffa4f-be3b-4056-89bd-73aad0032496 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e8ffa4f-be3b-4056-89bd-73aad0032496 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7e8ffa4f-be3b-4056-89bd-73aad0032496 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e8ffa4f-be3b-4056-89bd-73aad0032496'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7e8ffa4f-be3b-4056-89bd-73aad0032496 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] failed to remove resource iqn.2010-10.org.openstack:7e8ffa4f-be3b-4056-89bd-73aad0032496 because of JDSS resource iqn.2010-10.org.openstack:7e8ffa4f-be3b-4056-89bd-73aad0032496 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] deleating volume v_7e8ffa4f-be3b-4056-89bd-73aad0032496 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] get snapshots for volume v_7e8ffa4f-be3b-4056-89bd-73aad0032496 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e8ffa4f-be3b-4056-89bd-73aad0032496/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e8ffa4f-be3b-4056-89bd-73aad0032496/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e8ffa4f-be3b-4056-89bd-73aad0032496/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] get volume v_7e8ffa4f-be3b-4056-89bd-73aad0032496 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e8ffa4f-be3b-4056-89bd-73aad0032496 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e8ffa4f-be3b-4056-89bd-73aad0032496 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7e8ffa4f-be3b-4056-89bd-73aad0032496', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444600', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114128', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1117472665811321309', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '67f4ac45f8a22c0b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276057088', 'san:volume_id': '67f4ac45f8a22c0b68b2cc31a0fa5562ca9461c4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86259', 'name': 'v_7e8ffa4f-be3b-4056-89bd-73aad0032496', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e8ffa4f-be3b-4056-89bd-73aad0032496 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] delete volume:v_7e8ffa4f-be3b-4056-89bd-73aad0032496 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e8ffa4f-be3b-4056-89bd-73aad0032496 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e8ffa4f-be3b-4056-89bd-73aad0032496 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7e8ffa4f-be3b-4056-89bd-73aad0032496 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] volume v_7e8ffa4f-be3b-4056-89bd-73aad0032496 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:33:22 user cinder-volume[73403]: DEBUG cinder.quota [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Created reservations ['5efc048f-ec1d-4c28-af39-6ce185175e0e', 'd182a6db-c78a-4c67-814f-e0a4c57a7519', '14837ade-bf60-46d2-bcc7-5c5aafff262e', 'be3f1370-638f-4089-83e0-33d712913bc2'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:33:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:33:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:33:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276139008', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.manager [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:33:23 user cinder-volume[73403]: INFO cinder.volume.manager [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Deleted volume successfully. Apr 14 03:33:23 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=56,cinder:UPDATE=34,cinder:DELETE=4,cinder:INSERT=6 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.coordination [None req-b572d362-2a91-43e3-ae72-9e80089eb224 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Lock "cinder-7e8ffa4f-be3b-4056-89bd-73aad0032496-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.coordination [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Acquiring lock "cinder-9ae8ed28-852d-4da8-9119-2388424a0c19-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.coordination [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Lock "cinder-9ae8ed28-852d-4da8-9119-2388424a0c19-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] remove_export for volume: 9ae8ed28-852d-4da8-9119-2388424a0c19. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-947622766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9ae8ed28-852d-4da8-9119-2388424a0c19,launched_at=2023-04-14T03:33:12Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a418d76b384f51955aaffeabc15a4b',provider_auth='CHAP OknqVYlU c7xW4u30l1dXAa',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae8ed28-852d-4da8-9119-2388424a0c19 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:33:10Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:33:23Z,updated_at=2023-04-14T03:33:23Z,use_quota=True,user_id='c0dee0638b0844859007a81ad700bbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:9ae8ed28-852d-4da8-9119-2388424a0c19. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] detach volume v_9ae8ed28-852d-4da8-9119-2388424a0c19 from target iqn.2010-10.org.openstack:9ae8ed28-852d-4da8-9119-2388424a0c19 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ae8ed28-852d-4da8-9119-2388424a0c19/luns/v_9ae8ed28-852d-4da8-9119-2388424a0c19 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ae8ed28-852d-4da8-9119-2388424a0c19/luns/v_9ae8ed28-852d-4da8-9119-2388424a0c19 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9ae8ed28-852d-4da8-9119-2388424a0c19 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ae8ed28-852d-4da8-9119-2388424a0c19/luns/v_9ae8ed28-852d-4da8-9119-2388424a0c19'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ae8ed28-852d-4da8-9119-2388424a0c19/luns/v_9ae8ed28-852d-4da8-9119-2388424a0c19 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] failed to remove resource iqn.2010-10.org.openstack:9ae8ed28-852d-4da8-9119-2388424a0c19 because of JDSS resource v_9ae8ed28-852d-4da8-9119-2388424a0c19 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] delete target: iqn.2010-10.org.openstack:9ae8ed28-852d-4da8-9119-2388424a0c19 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] delete target iqn.2010-10.org.openstack:9ae8ed28-852d-4da8-9119-2388424a0c19 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ae8ed28-852d-4da8-9119-2388424a0c19 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ae8ed28-852d-4da8-9119-2388424a0c19 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9ae8ed28-852d-4da8-9119-2388424a0c19 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ae8ed28-852d-4da8-9119-2388424a0c19'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ae8ed28-852d-4da8-9119-2388424a0c19 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] failed to remove resource iqn.2010-10.org.openstack:9ae8ed28-852d-4da8-9119-2388424a0c19 because of JDSS resource iqn.2010-10.org.openstack:9ae8ed28-852d-4da8-9119-2388424a0c19 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] deleating volume v_9ae8ed28-852d-4da8-9119-2388424a0c19 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] get snapshots for volume v_9ae8ed28-852d-4da8-9119-2388424a0c19 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ae8ed28-852d-4da8-9119-2388424a0c19/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ae8ed28-852d-4da8-9119-2388424a0c19/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ae8ed28-852d-4da8-9119-2388424a0c19/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] get volume v_9ae8ed28-852d-4da8-9119-2388424a0c19 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ae8ed28-852d-4da8-9119-2388424a0c19 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:23 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ae8ed28-852d-4da8-9119-2388424a0c19 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9ae8ed28-852d-4da8-9119-2388424a0c19', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444600', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114131', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17617954237884623008', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9f682f7a8c76b213', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276139008', 'san:volume_id': '9f682f7a8c76b213f10bf0665716355dd4a0c584', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86633', 'name': 'v_9ae8ed28-852d-4da8-9119-2388424a0c19', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ae8ed28-852d-4da8-9119-2388424a0c19 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] delete volume:v_9ae8ed28-852d-4da8-9119-2388424a0c19 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:33:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ae8ed28-852d-4da8-9119-2388424a0c19 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ae8ed28-852d-4da8-9119-2388424a0c19 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ae8ed28-852d-4da8-9119-2388424a0c19 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] volume v_9ae8ed28-852d-4da8-9119-2388424a0c19 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:33:25 user cinder-volume[73403]: DEBUG cinder.quota [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Created reservations ['c1b4c68d-6d23-4df8-acd5-edc681271d94', '87ee7473-34fc-458e-a3b1-f402c845d3d3', 'ab35fa22-8190-4b18-8f96-1147c7f9818b', '11168f34-f874-4340-b8bf-614da34b77e6'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:33:25 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=58,cinder:UPDATE=30,cinder:DELETE=4,cinder:INSERT=8 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:33:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:33:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:33:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276233216', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.manager [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:33:26 user cinder-volume[73403]: INFO cinder.volume.manager [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Deleted volume successfully. Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.coordination [None req-fd724d37-3af6-4e02-a93f-0ba2f3c42fc6 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Lock "cinder-9ae8ed28-852d-4da8-9119-2388424a0c19-delete_volume" released by "delete_volume" :: held 3.000s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Acquiring lock "cinder-b9fe6a79-88f2-4067-bb54-f0cd665b5992-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Lock "cinder-b9fe6a79-88f2-4067-bb54-f0cd665b5992-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] remove_export for volume: b9fe6a79-88f2-4067-bb54-f0cd665b5992. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-589030899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b9fe6a79-88f2-4067-bb54-f0cd665b5992,launched_at=2023-04-14T03:33:11Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a418d76b384f51955aaffeabc15a4b',provider_auth='CHAP fiqydvNG 8mN07gV9zGseSR',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe6a79-88f2-4067-bb54-f0cd665b5992 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:33:10Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:33:27Z,updated_at=2023-04-14T03:33:27Z,use_quota=True,user_id='c0dee0638b0844859007a81ad700bbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:b9fe6a79-88f2-4067-bb54-f0cd665b5992. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] detach volume v_b9fe6a79-88f2-4067-bb54-f0cd665b5992 from target iqn.2010-10.org.openstack:b9fe6a79-88f2-4067-bb54-f0cd665b5992 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9fe6a79-88f2-4067-bb54-f0cd665b5992/luns/v_b9fe6a79-88f2-4067-bb54-f0cd665b5992 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9fe6a79-88f2-4067-bb54-f0cd665b5992/luns/v_b9fe6a79-88f2-4067-bb54-f0cd665b5992 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b9fe6a79-88f2-4067-bb54-f0cd665b5992 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9fe6a79-88f2-4067-bb54-f0cd665b5992/luns/v_b9fe6a79-88f2-4067-bb54-f0cd665b5992'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9fe6a79-88f2-4067-bb54-f0cd665b5992/luns/v_b9fe6a79-88f2-4067-bb54-f0cd665b5992 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] failed to remove resource iqn.2010-10.org.openstack:b9fe6a79-88f2-4067-bb54-f0cd665b5992 because of JDSS resource v_b9fe6a79-88f2-4067-bb54-f0cd665b5992 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] delete target: iqn.2010-10.org.openstack:b9fe6a79-88f2-4067-bb54-f0cd665b5992 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] delete target iqn.2010-10.org.openstack:b9fe6a79-88f2-4067-bb54-f0cd665b5992 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9fe6a79-88f2-4067-bb54-f0cd665b5992 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9fe6a79-88f2-4067-bb54-f0cd665b5992 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b9fe6a79-88f2-4067-bb54-f0cd665b5992 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9fe6a79-88f2-4067-bb54-f0cd665b5992'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b9fe6a79-88f2-4067-bb54-f0cd665b5992 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] failed to remove resource iqn.2010-10.org.openstack:b9fe6a79-88f2-4067-bb54-f0cd665b5992 because of JDSS resource iqn.2010-10.org.openstack:b9fe6a79-88f2-4067-bb54-f0cd665b5992 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] deleating volume v_b9fe6a79-88f2-4067-bb54-f0cd665b5992 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] get snapshots for volume v_b9fe6a79-88f2-4067-bb54-f0cd665b5992 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9fe6a79-88f2-4067-bb54-f0cd665b5992/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9fe6a79-88f2-4067-bb54-f0cd665b5992/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9fe6a79-88f2-4067-bb54-f0cd665b5992/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] get volume v_b9fe6a79-88f2-4067-bb54-f0cd665b5992 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:33:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9fe6a79-88f2-4067-bb54-f0cd665b5992 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9fe6a79-88f2-4067-bb54-f0cd665b5992 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b9fe6a79-88f2-4067-bb54-f0cd665b5992', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444599', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114124', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9828019276322155282', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '53bb83a271720111', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276233216', 'san:volume_id': '53bb83a271720111ca9b133d991cef94975cdf1e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86250', 'name': 'v_b9fe6a79-88f2-4067-bb54-f0cd665b5992', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9fe6a79-88f2-4067-bb54-f0cd665b5992 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] delete volume:v_b9fe6a79-88f2-4067-bb54-f0cd665b5992 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:33:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9fe6a79-88f2-4067-bb54-f0cd665b5992 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9fe6a79-88f2-4067-bb54-f0cd665b5992 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b9fe6a79-88f2-4067-bb54-f0cd665b5992 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] volume v_b9fe6a79-88f2-4067-bb54-f0cd665b5992 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.quota [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Created reservations ['c87ef0dd-d73b-40e4-a99c-200c791ed5ac', 'cccd388f-9e7b-4d36-b1ba-5e9428b7d0a6', '6bf41df2-dc7e-47f2-9741-88646f4f8b8c', '4178174f-fc67-447e-a8d9-22898ff5ca91'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276315136', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.manager [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:33:29 user cinder-volume[73403]: INFO cinder.volume.manager [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Deleted volume successfully. Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.coordination [None req-f9e7c5c6-b6c1-4906-9a01-61c835a66cc7 tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Lock "cinder-b9fe6a79-88f2-4067-bb54-f0cd665b5992-delete_volume" released by "delete_volume" :: held 3.147s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.coordination [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Acquiring lock "cinder-0037010f-9bd2-4ed2-8c8f-71dc1de7806e-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.coordination [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Lock "cinder-0037010f-9bd2-4ed2-8c8f-71dc1de7806e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] remove_export for volume: 0037010f-9bd2-4ed2-8c8f-71dc1de7806e. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-693315103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0037010f-9bd2-4ed2-8c8f-71dc1de7806e,launched_at=2023-04-14T03:33:09Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a418d76b384f51955aaffeabc15a4b',provider_auth='CHAP VBlwWyqd k2mOV0BUTC63Lg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037010f-9bd2-4ed2-8c8f-71dc1de7806e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:33:08Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:33:30Z,updated_at=2023-04-14T03:33:30Z,use_quota=True,user_id='c0dee0638b0844859007a81ad700bbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:0037010f-9bd2-4ed2-8c8f-71dc1de7806e. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] detach volume v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e from target iqn.2010-10.org.openstack:0037010f-9bd2-4ed2-8c8f-71dc1de7806e {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0037010f-9bd2-4ed2-8c8f-71dc1de7806e/luns/v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0037010f-9bd2-4ed2-8c8f-71dc1de7806e/luns/v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0037010f-9bd2-4ed2-8c8f-71dc1de7806e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0037010f-9bd2-4ed2-8c8f-71dc1de7806e/luns/v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0037010f-9bd2-4ed2-8c8f-71dc1de7806e/luns/v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] failed to remove resource iqn.2010-10.org.openstack:0037010f-9bd2-4ed2-8c8f-71dc1de7806e because of JDSS resource v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] delete target: iqn.2010-10.org.openstack:0037010f-9bd2-4ed2-8c8f-71dc1de7806e {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] delete target iqn.2010-10.org.openstack:0037010f-9bd2-4ed2-8c8f-71dc1de7806e {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0037010f-9bd2-4ed2-8c8f-71dc1de7806e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0037010f-9bd2-4ed2-8c8f-71dc1de7806e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0037010f-9bd2-4ed2-8c8f-71dc1de7806e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0037010f-9bd2-4ed2-8c8f-71dc1de7806e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0037010f-9bd2-4ed2-8c8f-71dc1de7806e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] failed to remove resource iqn.2010-10.org.openstack:0037010f-9bd2-4ed2-8c8f-71dc1de7806e because of JDSS resource iqn.2010-10.org.openstack:0037010f-9bd2-4ed2-8c8f-71dc1de7806e DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] deleating volume v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] get snapshots for volume v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] get volume v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:33:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444597', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114120', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10295010910284224678', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9cd00e7b272fe6cc', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276315136', 'san:volume_id': '9cd00e7b272fe6ccd9b4d4a8d4f3dad53e697c90', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87567', 'name': 'v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] delete volume:v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:33:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] volume v_0037010f-9bd2-4ed2-8c8f-71dc1de7806e deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:33:32 user cinder-volume[73403]: DEBUG cinder.quota [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Created reservations ['bf97b9cf-c69a-4016-b668-e64c7e52c3f3', '938787f6-5e4e-437e-ad22-0db04e3a488a', 'a5c7c8e5-9d95-499b-acb4-8ab0a73b4189', 'cd49d825-65f5-45d0-a976-8f6503c3c6a5'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:33:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:33:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:33:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:33:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:33:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276397056', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:33:32 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:33:32 user cinder-volume[73403]: DEBUG cinder.manager [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:33:32 user cinder-volume[73403]: INFO cinder.volume.manager [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Deleted volume successfully. Apr 14 03:33:32 user cinder-volume[73403]: DEBUG cinder.coordination [None req-1078b6b0-4313-49b8-8c58-b98d0b034a5e tempest-CreateVolumesFromSourceVolumeTest-894680490 None] Lock "cinder-0037010f-9bd2-4ed2-8c8f-71dc1de7806e-delete_volume" released by "delete_volume" :: held 2.959s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:34:02 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=38,cinder:INSERT=6,cinder:UPDATE=28,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:34:02 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=22,cinder:SELECT=32,cinder:INSERT=4,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:34:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:34:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:34:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:34:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:34:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:34:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276397056', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:34:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:34:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:34:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:34:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=7 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:34:52 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:34:53 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:34:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Flow 'volume_create_manager' (82731877-925e-4784-affa-cbdbac8a67dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:34:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be310e9-1f8b-4b9f-9788-e96edf439fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:34:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be310e9-1f8b-4b9f-9788-e96edf439fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-506053036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d5510540-ad8d-48a4-a43a-cc9e891ddfb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed26668c2cb49c38d16ff728d38bef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:34:54Z,use_quota=True,user_id='f88237b825b24effad17900bbf645ab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:34:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a615d1-55fc-4452-98ab-fecc3d797fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:34:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a615d1-55fc-4452-98ab-fecc3d797fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:34:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3b1473-30df-4ac7-9597-39f9fe26ef71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:34:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3b1473-30df-4ac7-9597-39f9fe26ef71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5510540-ad8d-48a4-a43a-cc9e891ddfb0', 'volume_name': 'volume-d5510540-ad8d-48a4-a43a-cc9e891ddfb0', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:34:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd81eab-0223-4732-a8c6-0bbd109da18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:34:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd81eab-0223-4732-a8c6-0bbd109da18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:34:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8cd03f4-edd2-4a57-a2e6-ab3138f7d4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:34:53 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Volume d5510540-ad8d-48a4-a43a-cc9e891ddfb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5510540-ad8d-48a4-a43a-cc9e891ddfb0', 'volume_size': 1} Apr 14 03:34:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] creating volume v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:34:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] create volume {'name': 'v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:34:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:34:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:34:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0', 'is_clone': False, 'name': 'v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:34:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8cd03f4-edd2-4a57-a2e6-ab3138f7d4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5510540-ad8d-48a4-a43a-cc9e891ddfb0', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:34:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4c7545-4866-4bf7-926a-83934a6f3397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:34:54 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Volume volume-d5510540-ad8d-48a4-a43a-cc9e891ddfb0 (d5510540-ad8d-48a4-a43a-cc9e891ddfb0): created successfully Apr 14 03:34:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4c7545-4866-4bf7-926a-83934a6f3397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:34:54 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Flow 'volume_create_manager' (82731877-925e-4784-affa-cbdbac8a67dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:34:54 user cinder-volume[73403]: INFO cinder.volume.manager [None req-babc5a36-72ad-4ef4-9db0-4e77dccc8361 tempest-AttachVolumeShelveTestJSON-1546459049 None] Created volume successfully. Apr 14 03:35:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:35:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:35:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:35:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:35:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:35:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276327424', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:35:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:35:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:35:13 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:35:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:35:52 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:36:02 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:36:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:36:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:36:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:36:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:36:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:36:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276315136', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:36:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:36:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:36:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:36:32 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:36:42 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:36:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-b17ae422-a606-4a11-a26e-76f00739e6f0 req-1e87e6c6-f068-4590-938a-55c7b7010cfd tempest-AttachVolumeShelveTestJSON-1546459049 None] No connector for attachment cd124197-30e8-4a95-a281-1ead0f8e5dd5; skipping storage backend terminate_connection call. {{(pid=73403) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4961}} Apr 14 03:36:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [req-b17ae422-a606-4a11-a26e-76f00739e6f0 req-1e87e6c6-f068-4590-938a-55c7b7010cfd tempest-AttachVolumeShelveTestJSON-1546459049 None] Deleting attachment cd124197-30e8-4a95-a281-1ead0f8e5dd5. {{(pid=73403) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 03:37:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:37:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:37:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:37:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:37:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:37:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276315136', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:37:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:37:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:37:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:37:22 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:37:42 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:38:02 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:38:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:38:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:38:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:38:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:38:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:38:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276315136', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:38:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:38:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:38:22 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:UPDATE=2,cinder:SELECT=5 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:38:33 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:38:43 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:39:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:39:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:39:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:39:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:39:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:39:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276315136', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:39:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:39:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:39:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:39:13 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:39:30 user cinder-volume[73403]: DEBUG cinder.coordination [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Acquiring lock "cinder-d5510540-ad8d-48a4-a43a-cc9e891ddfb0-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:39:30 user cinder-volume[73403]: DEBUG cinder.coordination [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Lock "cinder-d5510540-ad8d-48a4-a43a-cc9e891ddfb0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] remove_export for volume: d5510540-ad8d-48a4-a43a-cc9e891ddfb0. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-506053036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d5510540-ad8d-48a4-a43a-cc9e891ddfb0,launched_at=2023-04-14T03:34:55Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed26668c2cb49c38d16ff728d38bef2',provider_auth='CHAP GbqhZJoU hrXbAs45ZqE18y',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5510540-ad8d-48a4-a43a-cc9e891ddfb0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:34:54Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:39:31Z,updated_at=2023-04-14T03:39:31Z,use_quota=True,user_id='f88237b825b24effad17900bbf645ab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:d5510540-ad8d-48a4-a43a-cc9e891ddfb0. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] detach volume v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0 from target iqn.2010-10.org.openstack:d5510540-ad8d-48a4-a43a-cc9e891ddfb0 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d5510540-ad8d-48a4-a43a-cc9e891ddfb0/luns/v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d5510540-ad8d-48a4-a43a-cc9e891ddfb0/luns/v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d5510540-ad8d-48a4-a43a-cc9e891ddfb0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d5510540-ad8d-48a4-a43a-cc9e891ddfb0/luns/v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d5510540-ad8d-48a4-a43a-cc9e891ddfb0/luns/v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] failed to remove resource iqn.2010-10.org.openstack:d5510540-ad8d-48a4-a43a-cc9e891ddfb0 because of JDSS resource v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] delete target: iqn.2010-10.org.openstack:d5510540-ad8d-48a4-a43a-cc9e891ddfb0 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] delete target iqn.2010-10.org.openstack:d5510540-ad8d-48a4-a43a-cc9e891ddfb0 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d5510540-ad8d-48a4-a43a-cc9e891ddfb0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d5510540-ad8d-48a4-a43a-cc9e891ddfb0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d5510540-ad8d-48a4-a43a-cc9e891ddfb0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d5510540-ad8d-48a4-a43a-cc9e891ddfb0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d5510540-ad8d-48a4-a43a-cc9e891ddfb0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] failed to remove resource iqn.2010-10.org.openstack:d5510540-ad8d-48a4-a43a-cc9e891ddfb0 because of JDSS resource iqn.2010-10.org.openstack:d5510540-ad8d-48a4-a43a-cc9e891ddfb0 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] deleating volume v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] get snapshots for volume v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] get volume v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444703', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114166', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16655755122490808895', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ac2cf9dc51449ba1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276315136', 'san:volume_id': 'ac2cf9dc51449ba1482bc5777616790ee4452e21', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86876', 'name': 'v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] delete volume:v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:39:31 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:39:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:39:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] volume v_d5510540-ad8d-48a4-a43a-cc9e891ddfb0 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:39:33 user cinder-volume[73403]: DEBUG cinder.quota [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Created reservations ['cea38df4-5ffb-4373-ab68-dfd7236aadce', '7739036b-01f1-4b21-881e-20ffe10b87e3', 'ea284fea-4b1b-4e3e-826f-3877a0dc8b47', '8fb64aa8-55da-48a5-ba87-907f3087f5f0'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:39:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:39:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:39:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:39:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276384768', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.manager [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:39:34 user cinder-volume[73403]: INFO cinder.volume.manager [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Deleted volume successfully. Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.coordination [None req-51cab602-47db-42cc-bc9a-8f8096f04ddd tempest-AttachVolumeShelveTestJSON-1546459049 None] Lock "cinder-d5510540-ad8d-48a4-a43a-cc9e891ddfb0-delete_volume" released by "delete_volume" :: held 3.121s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.coordination [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Acquiring lock "cinder-206ed030-e355-423f-a35a-3598ef189cce-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.coordination [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Lock "cinder-206ed030-e355-423f-a35a-3598ef189cce-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] remove_export for volume: 206ed030-e355-423f-a35a-3598ef189cce. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-157469382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=206ed030-e355-423f-a35a-3598ef189cce,launched_at=2023-04-14T03:27:33Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed26668c2cb49c38d16ff728d38bef2',provider_auth='CHAP FkuMDwZI m0nJx3Lz7RivfX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:27:32Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:39:34Z,updated_at=2023-04-14T03:39:34Z,use_quota=True,user_id='f88237b825b24effad17900bbf645ab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] detach volume v_206ed030-e355-423f-a35a-3598ef189cce from target iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce/luns/v_206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce/luns/v_206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce/luns/v_206ed030-e355-423f-a35a-3598ef189cce'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce/luns/v_206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] failed to remove resource iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce because of JDSS resource v_206ed030-e355-423f-a35a-3598ef189cce DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] delete target: iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] delete target iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] failed to remove resource iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce because of JDSS resource iqn.2010-10.org.openstack:206ed030-e355-423f-a35a-3598ef189cce DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] deleating volume v_206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] get snapshots for volume v_206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_206ed030-e355-423f-a35a-3598ef189cce/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:39:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_206ed030-e355-423f-a35a-3598ef189cce/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:39:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_206ed030-e355-423f-a35a-3598ef189cce/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:39:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] get volume v_206ed030-e355-423f-a35a-3598ef189cce info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:39:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:39:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:39:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_206ed030-e355-423f-a35a-3598ef189cce', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681444261', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '113979', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5527995959830090997', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bf67909486a8b23a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276384768', 'san:volume_id': 'bf67909486a8b23a81c7b4294e6c0db99a9b1cb4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86625', 'name': 'v_206ed030-e355-423f-a35a-3598ef189cce', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:39:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] delete volume:v_206ed030-e355-423f-a35a-3598ef189cce recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:39:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:39:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:39:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_206ed030-e355-423f-a35a-3598ef189cce {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:39:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] volume v_206ed030-e355-423f-a35a-3598ef189cce deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:39:36 user cinder-volume[73403]: DEBUG cinder.quota [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Created reservations ['0d89c095-189b-44ca-9af6-b0674d313f31', '8fa7e13b-bfcf-4b0f-ba77-03405f51b91c', '3288040e-a29d-4d35-975e-5412833b1bb2', 'b249eab3-0355-421a-ae12-33e81cf3a74d'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:39:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:39:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:39:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:39:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:39:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276466688', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:39:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:39:37 user cinder-volume[73403]: DEBUG cinder.manager [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:39:37 user cinder-volume[73403]: INFO cinder.volume.manager [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Deleted volume successfully. Apr 14 03:39:37 user cinder-volume[73403]: DEBUG cinder.coordination [None req-55af5c64-fb99-4942-8c42-82894a8fd1f9 tempest-AttachVolumeShelveTestJSON-1546459049 None] Lock "cinder-206ed030-e355-423f-a35a-3598ef189cce-delete_volume" released by "delete_volume" :: held 2.969s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:39:53 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=32,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:39:53 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=27,cinder:INSERT=2,cinder:UPDATE=13 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:40:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:40:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:40:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:40:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:40:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:40:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276491264', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:40:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:40:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:40:33 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:40:33 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:41:03 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:41:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:41:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:41:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:41:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:41:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:41:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276478976', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:41:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:41:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:41:13 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:41:23 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:41:36 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:41:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Flow 'volume_create_manager' (901cd9d8-48d2-42f4-90e2-f1eb9de7bc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:41:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359d7e12-9d8f-41c6-b24e-8291a465bda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:41:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359d7e12-9d8f-41c6-b24e-8291a465bda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1108881192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a6a9daf2-f781-4826-b3e7-5abc9a628b9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='778eb822f6cb4f9c9c388ee7ed8a2071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:41:37Z,use_quota=True,user_id='2975e8c90d3e41dfa099c98f41635950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:41:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a4b8c1-be4c-4508-86b7-c649f5f58651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:41:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a4b8c1-be4c-4508-86b7-c649f5f58651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:41:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01403694-3426-4643-bcbc-9d2be2cd7e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:41:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01403694-3426-4643-bcbc-9d2be2cd7e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a9daf2-f781-4826-b3e7-5abc9a628b9c', 'volume_name': 'volume-a6a9daf2-f781-4826-b3e7-5abc9a628b9c', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:41:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badfc2bb-db7f-4dc7-81d6-e217de716153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:41:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badfc2bb-db7f-4dc7-81d6-e217de716153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:41:36 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49b226a-21a4-43ca-bd28-f91adb2bbea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:41:36 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Volume a6a9daf2-f781-4826-b3e7-5abc9a628b9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a9daf2-f781-4826-b3e7-5abc9a628b9c', 'volume_size': 1} Apr 14 03:41:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] creating volume v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:41:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] create volume {'name': 'v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:41:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:41:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:41:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c', 'is_clone': False, 'name': 'v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:41:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49b226a-21a4-43ca-bd28-f91adb2bbea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a9daf2-f781-4826-b3e7-5abc9a628b9c', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:41:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da56539f-8c32-4160-9218-b621e470098b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:41:37 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Volume volume-a6a9daf2-f781-4826-b3e7-5abc9a628b9c (a6a9daf2-f781-4826-b3e7-5abc9a628b9c): created successfully Apr 14 03:41:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da56539f-8c32-4160-9218-b621e470098b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:41:37 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Flow 'volume_create_manager' (901cd9d8-48d2-42f4-90e2-f1eb9de7bc33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:41:37 user cinder-volume[73403]: INFO cinder.volume.manager [None req-37732fb8-f708-44cd-9603-bbece3d16491 tempest-VolumesActionsTest-376578855 None] Created volume successfully. Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.coordination [None req-71a0b8bf-9894-4348-840b-b927078c6ed9 tempest-VolumesActionsTest-376578855 None] Acquiring lock "cinder-a6a9daf2-f781-4826-b3e7-5abc9a628b9c" by "attach_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.coordination [None req-71a0b8bf-9894-4348-840b-b927078c6ed9 tempest-VolumesActionsTest-376578855 None] Lock "cinder-a6a9daf2-f781-4826-b3e7-5abc9a628b9c" acquired by "attach_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:41:39 user cinder-volume[73403]: INFO cinder.volume.manager [None req-71a0b8bf-9894-4348-840b-b927078c6ed9 tempest-VolumesActionsTest-376578855 None] Attaching volume a6a9daf2-f781-4826-b3e7-5abc9a628b9c to instance 536a066d-074b-4a88-94d2-9815421b70da at mountpoint /dev/vdb on host None. Apr 14 03:41:39 user cinder-volume[73403]: INFO cinder.volume.manager [None req-71a0b8bf-9894-4348-840b-b927078c6ed9 tempest-VolumesActionsTest-376578855 None] Attach volume completed successfully. Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.coordination [None req-71a0b8bf-9894-4348-840b-b927078c6ed9 tempest-VolumesActionsTest-376578855 None] Lock "cinder-a6a9daf2-f781-4826-b3e7-5abc9a628b9c" released by "attach_volume" :: held 0.063s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] terminate connection for a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 03:41:39 user cinder-volume[73403]: INFO cinder.volume.manager [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] Terminate volume connection completed successfully. Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.coordination [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] Acquiring lock "cinder-a6a9daf2-f781-4826-b3e7-5abc9a628b9c-detach_volume" by "detach_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.coordination [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] Lock "cinder-a6a9daf2-f781-4826-b3e7-5abc9a628b9c-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:41:39 user cinder-volume[73403]: INFO cinder.volume.manager [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] Detaching volume a6a9daf2-f781-4826-b3e7-5abc9a628b9c from instance 536a066d-074b-4a88-94d2-9815421b70da. Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] remove_export for volume: a6a9daf2-f781-4826-b3e7-5abc9a628b9c. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] detach volume:Volume(_name_id=None,admin_metadata={attached_mode='rw',readonly='False'},attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1108881192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a6a9daf2-f781-4826-b3e7-5abc9a628b9c,launched_at=2023-04-14T03:41:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='778eb822f6cb4f9c9c388ee7ed8a2071',provider_auth='CHAP DVuRYhSc V5etbHk6qj3YXA',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:41:37Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='error',terminated_at=None,updated_at=2023-04-14T03:41:39Z,use_quota=True,user_id='2975e8c90d3e41dfa099c98f41635950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] detach volume v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c from target iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c/luns/v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c/luns/v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c/luns/v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c/luns/v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] failed to remove resource iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c because of JDSS resource v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] delete target: iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] delete target iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] failed to remove resource iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c because of JDSS resource iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:41:39 user cinder-volume[73403]: INFO cinder.volume.manager [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] Detach volume completed successfully. Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.coordination [None req-9bbcb0a2-deaa-4a2c-aff4-ef2e11c4a6d0 tempest-VolumesActionsTest-449936761 None] Lock "cinder-a6a9daf2-f781-4826-b3e7-5abc9a628b9c-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.coordination [None req-29214036-cd3a-40c7-9080-13e1cd96ede3 tempest-VolumesActionsTest-376578855 None] Acquiring lock "cinder-a6a9daf2-f781-4826-b3e7-5abc9a628b9c-detach_volume" by "detach_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.coordination [None req-29214036-cd3a-40c7-9080-13e1cd96ede3 tempest-VolumesActionsTest-376578855 None] Lock "cinder-a6a9daf2-f781-4826-b3e7-5abc9a628b9c-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:41:39 user cinder-volume[73403]: INFO cinder.volume.manager [None req-29214036-cd3a-40c7-9080-13e1cd96ede3 tempest-VolumesActionsTest-376578855 None] Volume detach called, but volume not attached. Apr 14 03:41:39 user cinder-volume[73403]: DEBUG cinder.coordination [None req-29214036-cd3a-40c7-9080-13e1cd96ede3 tempest-VolumesActionsTest-376578855 None] Lock "cinder-a6a9daf2-f781-4826-b3e7-5abc9a628b9c-detach_volume" released by "detach_volume" :: held 0.013s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.coordination [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Acquiring lock "cinder-a6a9daf2-f781-4826-b3e7-5abc9a628b9c-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.coordination [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Lock "cinder-a6a9daf2-f781-4826-b3e7-5abc9a628b9c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] remove_export for volume: a6a9daf2-f781-4826-b3e7-5abc9a628b9c. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] detach volume:Volume(_name_id=None,admin_metadata={readonly='False'},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1108881192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a6a9daf2-f781-4826-b3e7-5abc9a628b9c,launched_at=2023-04-14T03:41:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='778eb822f6cb4f9c9c388ee7ed8a2071',provider_auth='CHAP DVuRYhSc V5etbHk6qj3YXA',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:41:37Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:41:40Z,updated_at=2023-04-14T03:41:40Z,use_quota=True,user_id='2975e8c90d3e41dfa099c98f41635950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] detach volume v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c from target iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c/luns/v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c/luns/v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c/luns/v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c/luns/v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] failed to remove resource iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c because of JDSS resource v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] delete target: iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] delete target iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] failed to remove resource iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c because of JDSS resource iqn.2010-10.org.openstack:a6a9daf2-f781-4826-b3e7-5abc9a628b9c DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] deleating volume v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] get snapshots for volume v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] get volume v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681445106', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114251', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7911261242575509451', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a5409e6967a8f6c8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276347904', 'san:volume_id': 'a5409e6967a8f6c80c9b6bad6ff436c3e389ba0c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86765', 'name': 'v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] delete volume:v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:41:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:41:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:41:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] volume v_a6a9daf2-f781-4826-b3e7-5abc9a628b9c deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:41:42 user cinder-volume[73403]: DEBUG cinder.quota [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Created reservations ['69d06969-96b8-4271-b10f-bf3b8534e7c3', 'dd757d16-e0e7-4608-9324-4a5a9f7ea82f', '87a4e834-b336-47cb-a9ba-0c30593f6832', '0637e2be-f9cd-48f4-93f2-d7c7c6271bb0'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:41:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:41:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:41:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:41:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:41:43 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=40,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:41:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276429824', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:41:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:41:43 user cinder-volume[73403]: DEBUG cinder.manager [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:41:43 user cinder-volume[73403]: INFO cinder.volume.manager [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Deleted volume successfully. Apr 14 03:41:43 user cinder-volume[73403]: DEBUG cinder.coordination [None req-6fb23328-1795-49c5-a452-1793ff3bd799 tempest-VolumesActionsTest-376578855 None] Lock "cinder-a6a9daf2-f781-4826-b3e7-5abc9a628b9c-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:42:03 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=32,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:42:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:42:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:42:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:42:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276429824', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:42:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:42:23 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:42:23 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:42:34 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:42:34 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Flow 'volume_create_manager' (84a4d3c5-050a-4f30-a787-1d556c168fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:42:34 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbe2e01-6f2f-4134-a4be-81c51c875f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:34 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbe2e01-6f2f-4134-a4be-81c51c875f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1326760123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=07be16be-fc3d-46c1-9b3d-170f2328cd23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='778eb822f6cb4f9c9c388ee7ed8a2071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:42:34Z,use_quota=True,user_id='2975e8c90d3e41dfa099c98f41635950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:34 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbbf71af-d207-4510-a6f5-57d9f5413305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:34 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbbf71af-d207-4510-a6f5-57d9f5413305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:34 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8ae7a2-ac5c-42f4-932d-1d1a637b9d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:34 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8ae7a2-ac5c-42f4-932d-1d1a637b9d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07be16be-fc3d-46c1-9b3d-170f2328cd23', 'volume_name': 'volume-07be16be-fc3d-46c1-9b3d-170f2328cd23', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:34 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026520c8-31d2-421a-a974-46798a691941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:34 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026520c8-31d2-421a-a974-46798a691941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:34 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4280b610-df3d-481f-b302-ea13b30deba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:34 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Volume 07be16be-fc3d-46c1-9b3d-170f2328cd23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07be16be-fc3d-46c1-9b3d-170f2328cd23', 'volume_size': 1} Apr 14 03:42:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] creating volume v_07be16be-fc3d-46c1-9b3d-170f2328cd23. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:42:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] create volume {'name': 'v_07be16be-fc3d-46c1-9b3d-170f2328cd23', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:42:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:35 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_07be16be-fc3d-46c1-9b3d-170f2328cd23', 'is_clone': False, 'name': 'v_07be16be-fc3d-46c1-9b3d-170f2328cd23'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4280b610-df3d-481f-b302-ea13b30deba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07be16be-fc3d-46c1-9b3d-170f2328cd23', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0d7497-9c15-4833-b350-10f3a0f54edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:35 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Volume volume-07be16be-fc3d-46c1-9b3d-170f2328cd23 (07be16be-fc3d-46c1-9b3d-170f2328cd23): created successfully Apr 14 03:42:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0d7497-9c15-4833-b350-10f3a0f54edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:35 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Flow 'volume_create_manager' (84a4d3c5-050a-4f30-a787-1d556c168fed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:42:35 user cinder-volume[73403]: INFO cinder.volume.manager [None req-28ae33d1-12e8-4cb8-b1c6-18c637d64df1 tempest-VolumesActionsTest-376578855 None] Created volume successfully. Apr 14 03:42:36 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Acquiring lock "cinder-07be16be-fc3d-46c1-9b3d-170f2328cd23-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:42:36 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Lock "cinder-07be16be-fc3d-46c1-9b3d-170f2328cd23-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:42:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] remove_export for volume: 07be16be-fc3d-46c1-9b3d-170f2328cd23. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:42:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:42:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1326760123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=07be16be-fc3d-46c1-9b3d-170f2328cd23,launched_at=2023-04-14T03:42:35Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='778eb822f6cb4f9c9c388ee7ed8a2071',provider_auth='CHAP XHLTwedV pdro75EBakfn4I',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:07be16be-fc3d-46c1-9b3d-170f2328cd23 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:42:34Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:42:37Z,updated_at=2023-04-14T03:42:37Z,use_quota=True,user_id='2975e8c90d3e41dfa099c98f41635950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:07be16be-fc3d-46c1-9b3d-170f2328cd23. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:42:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] detach volume v_07be16be-fc3d-46c1-9b3d-170f2328cd23 from target iqn.2010-10.org.openstack:07be16be-fc3d-46c1-9b3d-170f2328cd23 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:42:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07be16be-fc3d-46c1-9b3d-170f2328cd23/luns/v_07be16be-fc3d-46c1-9b3d-170f2328cd23 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07be16be-fc3d-46c1-9b3d-170f2328cd23/luns/v_07be16be-fc3d-46c1-9b3d-170f2328cd23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:07be16be-fc3d-46c1-9b3d-170f2328cd23 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07be16be-fc3d-46c1-9b3d-170f2328cd23/luns/v_07be16be-fc3d-46c1-9b3d-170f2328cd23'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07be16be-fc3d-46c1-9b3d-170f2328cd23/luns/v_07be16be-fc3d-46c1-9b3d-170f2328cd23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] failed to remove resource iqn.2010-10.org.openstack:07be16be-fc3d-46c1-9b3d-170f2328cd23 because of JDSS resource v_07be16be-fc3d-46c1-9b3d-170f2328cd23 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:42:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] delete target: iqn.2010-10.org.openstack:07be16be-fc3d-46c1-9b3d-170f2328cd23 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:42:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] delete target iqn.2010-10.org.openstack:07be16be-fc3d-46c1-9b3d-170f2328cd23 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:42:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07be16be-fc3d-46c1-9b3d-170f2328cd23 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07be16be-fc3d-46c1-9b3d-170f2328cd23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:07be16be-fc3d-46c1-9b3d-170f2328cd23 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07be16be-fc3d-46c1-9b3d-170f2328cd23'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:07be16be-fc3d-46c1-9b3d-170f2328cd23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] failed to remove resource iqn.2010-10.org.openstack:07be16be-fc3d-46c1-9b3d-170f2328cd23 because of JDSS resource iqn.2010-10.org.openstack:07be16be-fc3d-46c1-9b3d-170f2328cd23 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:42:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] deleating volume v_07be16be-fc3d-46c1-9b3d-170f2328cd23 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:42:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] get snapshots for volume v_07be16be-fc3d-46c1-9b3d-170f2328cd23 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:42:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07be16be-fc3d-46c1-9b3d-170f2328cd23/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07be16be-fc3d-46c1-9b3d-170f2328cd23/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07be16be-fc3d-46c1-9b3d-170f2328cd23/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] get volume v_07be16be-fc3d-46c1-9b3d-170f2328cd23 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:42:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07be16be-fc3d-46c1-9b3d-170f2328cd23 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07be16be-fc3d-46c1-9b3d-170f2328cd23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_07be16be-fc3d-46c1-9b3d-170f2328cd23', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681445163', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114266', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12613124641281289203', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '60c7f14f4a5179ba', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276347904', 'san:volume_id': '60c7f14f4a5179bab9ba714a73820d772fb7f6d9', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87468', 'name': 'v_07be16be-fc3d-46c1-9b3d-170f2328cd23', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07be16be-fc3d-46c1-9b3d-170f2328cd23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] delete volume:v_07be16be-fc3d-46c1-9b3d-170f2328cd23 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:42:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07be16be-fc3d-46c1-9b3d-170f2328cd23 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07be16be-fc3d-46c1-9b3d-170f2328cd23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_07be16be-fc3d-46c1-9b3d-170f2328cd23 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] volume v_07be16be-fc3d-46c1-9b3d-170f2328cd23 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:42:38 user cinder-volume[73403]: DEBUG cinder.quota [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Created reservations ['1981080b-90b7-41ba-bb63-4350b00da91f', '109433da-d189-44ce-836c-15c947760d6c', 'cbd8b766-b532-4a57-aae6-aa6204e96bbc', '30af1272-7e65-424b-9637-08d8118b904d'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:42:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:42:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:42:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276429824', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:42:39 user cinder-volume[73403]: DEBUG cinder.manager [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:42:39 user cinder-volume[73403]: INFO cinder.volume.manager [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Deleted volume successfully. Apr 14 03:42:39 user cinder-volume[73403]: DEBUG cinder.coordination [None req-e64d41a9-bcdf-4802-a941-af67661e0925 tempest-VolumesActionsTest-449936761 None] Lock "cinder-07be16be-fc3d-46c1-9b3d-170f2328cd23-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:42:40 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:42:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Flow 'volume_create_manager' (a4cb3c15-89ac-4a45-9a37-37ad76b54d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:42:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba7f625-250c-4e17-8b11-cc21a35e3964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba7f625-250c-4e17-8b11-cc21a35e3964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-58739046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d8005dd3-4c4e-4f0a-8d7f-f8503d01b393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='778eb822f6cb4f9c9c388ee7ed8a2071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:42:40Z,use_quota=True,user_id='2975e8c90d3e41dfa099c98f41635950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7746ee8e-c836-489a-afbb-18648d0f3efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7746ee8e-c836-489a-afbb-18648d0f3efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1ec218-9226-4235-8d7d-82f673cda745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1ec218-9226-4235-8d7d-82f673cda745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8005dd3-4c4e-4f0a-8d7f-f8503d01b393', 'volume_name': 'volume-d8005dd3-4c4e-4f0a-8d7f-f8503d01b393', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a035a32f-d3eb-4981-87b2-f24972f4684d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a035a32f-d3eb-4981-87b2-f24972f4684d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:40 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8b0abc-627f-47ac-b9ce-85aaf5df3ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:40 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Volume d8005dd3-4c4e-4f0a-8d7f-f8503d01b393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8005dd3-4c4e-4f0a-8d7f-f8503d01b393', 'volume_size': 1} Apr 14 03:42:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] creating volume v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:42:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] create volume {'name': 'v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:42:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:41 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393', 'is_clone': False, 'name': 'v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:41 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8b0abc-627f-47ac-b9ce-85aaf5df3ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8005dd3-4c4e-4f0a-8d7f-f8503d01b393', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:41 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41db1a50-c7b3-4f5a-9b5c-2634e26a6965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:41 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Volume volume-d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 (d8005dd3-4c4e-4f0a-8d7f-f8503d01b393): created successfully Apr 14 03:42:41 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41db1a50-c7b3-4f5a-9b5c-2634e26a6965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:41 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Flow 'volume_create_manager' (a4cb3c15-89ac-4a45-9a37-37ad76b54d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:42:41 user cinder-volume[73403]: INFO cinder.volume.manager [None req-7b087b74-4786-4e41-a70a-f44a1864fbaf tempest-VolumesActionsTest-376578855 None] Created volume successfully. Apr 14 03:42:42 user cinder-volume[73403]: DEBUG cinder.coordination [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Acquiring lock "cinder-d8005dd3-4c4e-4f0a-8d7f-f8503d01b393-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:42:42 user cinder-volume[73403]: DEBUG cinder.coordination [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Lock "cinder-d8005dd3-4c4e-4f0a-8d7f-f8503d01b393-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:42:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] remove_export for volume: d8005dd3-4c4e-4f0a-8d7f-f8503d01b393. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:42:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:42:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-58739046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d8005dd3-4c4e-4f0a-8d7f-f8503d01b393,launched_at=2023-04-14T03:42:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='778eb822f6cb4f9c9c388ee7ed8a2071',provider_auth='CHAP pPKvCSAQ PAj7Q5kexGNMpr',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:42:40Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:42:42Z,updated_at=2023-04-14T03:42:42Z,use_quota=True,user_id='2975e8c90d3e41dfa099c98f41635950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:d8005dd3-4c4e-4f0a-8d7f-f8503d01b393. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:42:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] detach volume v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 from target iqn.2010-10.org.openstack:d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:42:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8005dd3-4c4e-4f0a-8d7f-f8503d01b393/luns/v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8005dd3-4c4e-4f0a-8d7f-f8503d01b393/luns/v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8005dd3-4c4e-4f0a-8d7f-f8503d01b393/luns/v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8005dd3-4c4e-4f0a-8d7f-f8503d01b393/luns/v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] failed to remove resource iqn.2010-10.org.openstack:d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 because of JDSS resource v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:42:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] delete target: iqn.2010-10.org.openstack:d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:42:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] delete target iqn.2010-10.org.openstack:d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:42:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8005dd3-4c4e-4f0a-8d7f-f8503d01b393'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] failed to remove resource iqn.2010-10.org.openstack:d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 because of JDSS resource iqn.2010-10.org.openstack:d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:42:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] deleating volume v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:42:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] get snapshots for volume v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:42:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:42 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] get volume v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:42:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681445169', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114271', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '559208786654268726', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1ed176d9f913ab0a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276335616', 'san:volume_id': '1ed176d9f913ab0a9a92ba42ae07fc289e51e931', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86271', 'name': 'v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] delete volume:v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:42:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] volume v_d8005dd3-4c4e-4f0a-8d7f-f8503d01b393 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:42:44 user cinder-volume[73403]: DEBUG cinder.quota [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Created reservations ['b758f0c3-cdc4-4a08-95bb-8713770f2be5', '4adca9e7-1881-460d-bc15-42216bb1cac2', '9309775e-6f90-4032-add4-d482c39bf767', '831872ec-cbd4-4dbd-9419-d7f56d22f803'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:42:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:42:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:42:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276417536', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:42:45 user cinder-volume[73403]: DEBUG cinder.manager [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:42:45 user cinder-volume[73403]: INFO cinder.volume.manager [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Deleted volume successfully. Apr 14 03:42:45 user cinder-volume[73403]: DEBUG cinder.coordination [None req-157f051a-2e8c-4719-bcf2-3d518217a19b tempest-VolumesActionsTest-449936761 None] Lock "cinder-d8005dd3-4c4e-4f0a-8d7f-f8503d01b393-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:42:46 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:42:46 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Flow 'volume_create_manager' (377d906a-beca-4eb1-b27e-0c6aef6351b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:42:46 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082775cc-887d-4b53-9b76-fcf2f9e3e070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:46 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082775cc-887d-4b53-9b76-fcf2f9e3e070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1106654880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9716c1d4-ee3b-4675-aa95-d98b55c68bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='778eb822f6cb4f9c9c388ee7ed8a2071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:42:46Z,use_quota=True,user_id='2975e8c90d3e41dfa099c98f41635950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:46 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3fbb249-5591-4ef2-921e-cbe34ac03c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:46 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3fbb249-5591-4ef2-921e-cbe34ac03c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:46 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909dfd25-e9f7-44f8-9c61-a531860b3b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:46 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909dfd25-e9f7-44f8-9c61-a531860b3b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9716c1d4-ee3b-4675-aa95-d98b55c68bfd', 'volume_name': 'volume-9716c1d4-ee3b-4675-aa95-d98b55c68bfd', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:46 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8bede1-493b-49ff-ae4c-f5f85305c7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:46 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8bede1-493b-49ff-ae4c-f5f85305c7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:46 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034ff148-7ee6-430d-8272-fccd58a0c614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:46 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Volume 9716c1d4-ee3b-4675-aa95-d98b55c68bfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9716c1d4-ee3b-4675-aa95-d98b55c68bfd', 'volume_size': 1} Apr 14 03:42:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] creating volume v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:42:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] create volume {'name': 'v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:42:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd', 'is_clone': False, 'name': 'v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034ff148-7ee6-430d-8272-fccd58a0c614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9716c1d4-ee3b-4675-aa95-d98b55c68bfd', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51d5f92-0238-4879-8bce-5886a4437365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:47 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Volume volume-9716c1d4-ee3b-4675-aa95-d98b55c68bfd (9716c1d4-ee3b-4675-aa95-d98b55c68bfd): created successfully Apr 14 03:42:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51d5f92-0238-4879-8bce-5886a4437365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Flow 'volume_create_manager' (377d906a-beca-4eb1-b27e-0c6aef6351b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:42:47 user cinder-volume[73403]: INFO cinder.volume.manager [None req-88012351-266b-40bc-83b8-fb3f25e902e1 tempest-VolumesActionsTest-376578855 None] Created volume successfully. Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.coordination [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Acquiring lock "cinder-9716c1d4-ee3b-4675-aa95-d98b55c68bfd-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.coordination [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Lock "cinder-9716c1d4-ee3b-4675-aa95-d98b55c68bfd-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] remove_export for volume: 9716c1d4-ee3b-4675-aa95-d98b55c68bfd. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1106654880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9716c1d4-ee3b-4675-aa95-d98b55c68bfd,launched_at=2023-04-14T03:42:47Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='778eb822f6cb4f9c9c388ee7ed8a2071',provider_auth='CHAP urzaLmYd rpzNqbg1RkM8Tl',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9716c1d4-ee3b-4675-aa95-d98b55c68bfd 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:42:46Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:42:48Z,updated_at=2023-04-14T03:42:48Z,use_quota=True,user_id='2975e8c90d3e41dfa099c98f41635950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:9716c1d4-ee3b-4675-aa95-d98b55c68bfd. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] detach volume v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd from target iqn.2010-10.org.openstack:9716c1d4-ee3b-4675-aa95-d98b55c68bfd {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9716c1d4-ee3b-4675-aa95-d98b55c68bfd/luns/v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9716c1d4-ee3b-4675-aa95-d98b55c68bfd/luns/v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9716c1d4-ee3b-4675-aa95-d98b55c68bfd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9716c1d4-ee3b-4675-aa95-d98b55c68bfd/luns/v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9716c1d4-ee3b-4675-aa95-d98b55c68bfd/luns/v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] failed to remove resource iqn.2010-10.org.openstack:9716c1d4-ee3b-4675-aa95-d98b55c68bfd because of JDSS resource v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] delete target: iqn.2010-10.org.openstack:9716c1d4-ee3b-4675-aa95-d98b55c68bfd {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] delete target iqn.2010-10.org.openstack:9716c1d4-ee3b-4675-aa95-d98b55c68bfd {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9716c1d4-ee3b-4675-aa95-d98b55c68bfd {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9716c1d4-ee3b-4675-aa95-d98b55c68bfd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9716c1d4-ee3b-4675-aa95-d98b55c68bfd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9716c1d4-ee3b-4675-aa95-d98b55c68bfd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9716c1d4-ee3b-4675-aa95-d98b55c68bfd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] failed to remove resource iqn.2010-10.org.openstack:9716c1d4-ee3b-4675-aa95-d98b55c68bfd because of JDSS resource iqn.2010-10.org.openstack:9716c1d4-ee3b-4675-aa95-d98b55c68bfd DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] deleating volume v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] get snapshots for volume v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] get volume v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681445175', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114276', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13385070124454853283', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a32bfeb34acbd89a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276335616', 'san:volume_id': 'a32bfeb34acbd89ac7d55733f7515b6d944f79b7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87333', 'name': 'v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] delete volume:v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] volume v_9716c1d4-ee3b-4675-aa95-d98b55c68bfd deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:42:50 user cinder-volume[73403]: DEBUG cinder.quota [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Created reservations ['fca04874-08de-49fc-9d38-b490bb075dbc', '0b5adf7d-2576-4fcf-aa93-906bf2ebb20b', '7fbadbaa-b68b-4f31-a061-3365b67555e8', 'c63b0035-b2a1-4b5e-bbcb-0cff6a2c51cb'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:42:50 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=57,cinder:UPDATE=32,cinder:DELETE=3,cinder:INSERT=8 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:42:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:42:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:42:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276417536', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:42:51 user cinder-volume[73403]: DEBUG cinder.manager [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:42:51 user cinder-volume[73403]: INFO cinder.volume.manager [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Deleted volume successfully. Apr 14 03:42:51 user cinder-volume[73403]: DEBUG cinder.coordination [None req-910e4144-bf47-4e27-b004-eacfe69c200d tempest-VolumesActionsTest-449936761 None] Lock "cinder-9716c1d4-ee3b-4675-aa95-d98b55c68bfd-delete_volume" released by "delete_volume" :: held 2.951s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:42:51 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:42:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Flow 'volume_create_manager' (e2b2b21d-eb7e-4dac-9dd2-55e5efa4eb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:42:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7dde2b-661a-4e48-bd66-b1612da8de71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7dde2b-661a-4e48-bd66-b1612da8de71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-20850094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=57df0440-fbc6-4273-823d-b0fc98a4cbbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='778eb822f6cb4f9c9c388ee7ed8a2071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:42:52Z,use_quota=True,user_id='2975e8c90d3e41dfa099c98f41635950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540961c0-23bc-4a5c-8176-6269a53c0b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540961c0-23bc-4a5c-8176-6269a53c0b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0731dbd7-6e64-42f9-8a7e-3bebaa50bbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0731dbd7-6e64-42f9-8a7e-3bebaa50bbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57df0440-fbc6-4273-823d-b0fc98a4cbbf', 'volume_name': 'volume-57df0440-fbc6-4273-823d-b0fc98a4cbbf', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2a70b1-85bc-48b8-b870-179d706526bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2a70b1-85bc-48b8-b870-179d706526bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:51 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189f110a-5527-4e72-98bf-a8f218fd0226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:51 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Volume 57df0440-fbc6-4273-823d-b0fc98a4cbbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57df0440-fbc6-4273-823d-b0fc98a4cbbf', 'volume_size': 1} Apr 14 03:42:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] creating volume v_57df0440-fbc6-4273-823d-b0fc98a4cbbf. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:42:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] create volume {'name': 'v_57df0440-fbc6-4273-823d-b0fc98a4cbbf', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:42:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:52 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_57df0440-fbc6-4273-823d-b0fc98a4cbbf', 'is_clone': False, 'name': 'v_57df0440-fbc6-4273-823d-b0fc98a4cbbf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:52 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189f110a-5527-4e72-98bf-a8f218fd0226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57df0440-fbc6-4273-823d-b0fc98a4cbbf', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487f2f9a-28dd-48fb-a6d1-a2227dee4aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:53 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Volume volume-57df0440-fbc6-4273-823d-b0fc98a4cbbf (57df0440-fbc6-4273-823d-b0fc98a4cbbf): created successfully Apr 14 03:42:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487f2f9a-28dd-48fb-a6d1-a2227dee4aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:53 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Flow 'volume_create_manager' (e2b2b21d-eb7e-4dac-9dd2-55e5efa4eb95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:42:53 user cinder-volume[73403]: INFO cinder.volume.manager [None req-16e716f4-39e9-4cbf-a3f1-f0ee62699833 tempest-VolumesActionsTest-376578855 None] Created volume successfully. Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.coordination [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Acquiring lock "cinder-57df0440-fbc6-4273-823d-b0fc98a4cbbf-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.coordination [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Lock "cinder-57df0440-fbc6-4273-823d-b0fc98a4cbbf-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=50,cinder:UPDATE=33,cinder:INSERT=4,cinder:DELETE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] remove_export for volume: 57df0440-fbc6-4273-823d-b0fc98a4cbbf. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-20850094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=57df0440-fbc6-4273-823d-b0fc98a4cbbf,launched_at=2023-04-14T03:42:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='778eb822f6cb4f9c9c388ee7ed8a2071',provider_auth='CHAP BiFshDle VYZNrqB9KdDAnO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:57df0440-fbc6-4273-823d-b0fc98a4cbbf 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:42:52Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:42:54Z,updated_at=2023-04-14T03:42:54Z,use_quota=True,user_id='2975e8c90d3e41dfa099c98f41635950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:57df0440-fbc6-4273-823d-b0fc98a4cbbf. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] detach volume v_57df0440-fbc6-4273-823d-b0fc98a4cbbf from target iqn.2010-10.org.openstack:57df0440-fbc6-4273-823d-b0fc98a4cbbf {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:57df0440-fbc6-4273-823d-b0fc98a4cbbf/luns/v_57df0440-fbc6-4273-823d-b0fc98a4cbbf {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:57df0440-fbc6-4273-823d-b0fc98a4cbbf/luns/v_57df0440-fbc6-4273-823d-b0fc98a4cbbf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:57df0440-fbc6-4273-823d-b0fc98a4cbbf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:57df0440-fbc6-4273-823d-b0fc98a4cbbf/luns/v_57df0440-fbc6-4273-823d-b0fc98a4cbbf'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:57df0440-fbc6-4273-823d-b0fc98a4cbbf/luns/v_57df0440-fbc6-4273-823d-b0fc98a4cbbf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] failed to remove resource iqn.2010-10.org.openstack:57df0440-fbc6-4273-823d-b0fc98a4cbbf because of JDSS resource v_57df0440-fbc6-4273-823d-b0fc98a4cbbf DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] delete target: iqn.2010-10.org.openstack:57df0440-fbc6-4273-823d-b0fc98a4cbbf {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] delete target iqn.2010-10.org.openstack:57df0440-fbc6-4273-823d-b0fc98a4cbbf {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:57df0440-fbc6-4273-823d-b0fc98a4cbbf {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:57df0440-fbc6-4273-823d-b0fc98a4cbbf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:57df0440-fbc6-4273-823d-b0fc98a4cbbf not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:57df0440-fbc6-4273-823d-b0fc98a4cbbf'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:57df0440-fbc6-4273-823d-b0fc98a4cbbf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] failed to remove resource iqn.2010-10.org.openstack:57df0440-fbc6-4273-823d-b0fc98a4cbbf because of JDSS resource iqn.2010-10.org.openstack:57df0440-fbc6-4273-823d-b0fc98a4cbbf DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] deleating volume v_57df0440-fbc6-4273-823d-b0fc98a4cbbf {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] get snapshots for volume v_57df0440-fbc6-4273-823d-b0fc98a4cbbf {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_57df0440-fbc6-4273-823d-b0fc98a4cbbf/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_57df0440-fbc6-4273-823d-b0fc98a4cbbf/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_57df0440-fbc6-4273-823d-b0fc98a4cbbf/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] get volume v_57df0440-fbc6-4273-823d-b0fc98a4cbbf info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_57df0440-fbc6-4273-823d-b0fc98a4cbbf {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_57df0440-fbc6-4273-823d-b0fc98a4cbbf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_57df0440-fbc6-4273-823d-b0fc98a4cbbf', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681445181', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114281', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11924256042344348017', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f0e597e6f688d013', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276347904', 'san:volume_id': 'f0e597e6f688d013c9c83ee002e3f6d5f9137bfd', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87344', 'name': 'v_57df0440-fbc6-4273-823d-b0fc98a4cbbf', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_57df0440-fbc6-4273-823d-b0fc98a4cbbf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] delete volume:v_57df0440-fbc6-4273-823d-b0fc98a4cbbf recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_57df0440-fbc6-4273-823d-b0fc98a4cbbf {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_57df0440-fbc6-4273-823d-b0fc98a4cbbf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_57df0440-fbc6-4273-823d-b0fc98a4cbbf {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] volume v_57df0440-fbc6-4273-823d-b0fc98a4cbbf deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:42:56 user cinder-volume[73403]: DEBUG cinder.quota [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Created reservations ['1957119a-73e9-4be3-b7f1-e0415abfe484', 'c3c3e829-1582-49a5-a8c2-ac9fd80f61b3', 'ba882bfd-911d-41c9-9d19-a3ef241b1dd5', '0ca7845a-5997-4922-920f-ef016c5a931b'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:42:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:42:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:42:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276429824', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:42:57 user cinder-volume[73403]: DEBUG cinder.manager [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:42:57 user cinder-volume[73403]: INFO cinder.volume.manager [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Deleted volume successfully. Apr 14 03:42:57 user cinder-volume[73403]: DEBUG cinder.coordination [None req-4a689428-eb6c-448a-b696-09c8b8a7be90 tempest-VolumesActionsTest-449936761 None] Lock "cinder-57df0440-fbc6-4273-823d-b0fc98a4cbbf-delete_volume" released by "delete_volume" :: held 3.023s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:42:57 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:42:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Flow 'volume_create_manager' (7b577c83-a20b-4a30-999e-cc7094ac59f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:42:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c33421-30df-4e36-8ab7-496a2878a591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c33421-30df-4e36-8ab7-496a2878a591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1977409820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a7163a61-f4ba-4976-87e6-77c219f8bc82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='778eb822f6cb4f9c9c388ee7ed8a2071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:42:58Z,use_quota=True,user_id='2975e8c90d3e41dfa099c98f41635950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a097a2-4928-457a-b7f7-75fb6c94ef8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a097a2-4928-457a-b7f7-75fb6c94ef8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a6446c-5955-420d-81c4-32419f46a231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a6446c-5955-420d-81c4-32419f46a231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7163a61-f4ba-4976-87e6-77c219f8bc82', 'volume_name': 'volume-a7163a61-f4ba-4976-87e6-77c219f8bc82', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f08e7e-dbcf-40f4-8902-637ab746249d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f08e7e-dbcf-40f4-8902-637ab746249d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:57 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e41958f-849e-479d-a137-7fd4815378e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:57 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Volume a7163a61-f4ba-4976-87e6-77c219f8bc82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7163a61-f4ba-4976-87e6-77c219f8bc82', 'volume_size': 1} Apr 14 03:42:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] creating volume v_a7163a61-f4ba-4976-87e6-77c219f8bc82. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:42:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] create volume {'name': 'v_a7163a61-f4ba-4976-87e6-77c219f8bc82', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:42:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a7163a61-f4ba-4976-87e6-77c219f8bc82', 'is_clone': False, 'name': 'v_a7163a61-f4ba-4976-87e6-77c219f8bc82'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e41958f-849e-479d-a137-7fd4815378e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7163a61-f4ba-4976-87e6-77c219f8bc82', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc9ac3ed-709d-41be-9e60-149845fa0e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:42:58 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Volume volume-a7163a61-f4ba-4976-87e6-77c219f8bc82 (a7163a61-f4ba-4976-87e6-77c219f8bc82): created successfully Apr 14 03:42:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc9ac3ed-709d-41be-9e60-149845fa0e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:42:58 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Flow 'volume_create_manager' (7b577c83-a20b-4a30-999e-cc7094ac59f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:42:58 user cinder-volume[73403]: INFO cinder.volume.manager [None req-abb2674b-94aa-4af1-a923-2bbc4601096b tempest-VolumesActionsTest-376578855 None] Created volume successfully. Apr 14 03:42:59 user cinder-volume[73403]: DEBUG cinder.coordination [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Acquiring lock "cinder-a7163a61-f4ba-4976-87e6-77c219f8bc82-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:42:59 user cinder-volume[73403]: DEBUG cinder.coordination [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Lock "cinder-a7163a61-f4ba-4976-87e6-77c219f8bc82-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:42:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] remove_export for volume: a7163a61-f4ba-4976-87e6-77c219f8bc82. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:42:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:42:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1977409820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a7163a61-f4ba-4976-87e6-77c219f8bc82,launched_at=2023-04-14T03:42:59Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='778eb822f6cb4f9c9c388ee7ed8a2071',provider_auth='CHAP jCOipSJD MZ86zxBQ9q5vYi',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7163a61-f4ba-4976-87e6-77c219f8bc82 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:42:58Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:42:59Z,updated_at=2023-04-14T03:42:59Z,use_quota=True,user_id='2975e8c90d3e41dfa099c98f41635950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:a7163a61-f4ba-4976-87e6-77c219f8bc82. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:42:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] detach volume v_a7163a61-f4ba-4976-87e6-77c219f8bc82 from target iqn.2010-10.org.openstack:a7163a61-f4ba-4976-87e6-77c219f8bc82 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:42:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7163a61-f4ba-4976-87e6-77c219f8bc82/luns/v_a7163a61-f4ba-4976-87e6-77c219f8bc82 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7163a61-f4ba-4976-87e6-77c219f8bc82/luns/v_a7163a61-f4ba-4976-87e6-77c219f8bc82 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a7163a61-f4ba-4976-87e6-77c219f8bc82 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7163a61-f4ba-4976-87e6-77c219f8bc82/luns/v_a7163a61-f4ba-4976-87e6-77c219f8bc82'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7163a61-f4ba-4976-87e6-77c219f8bc82/luns/v_a7163a61-f4ba-4976-87e6-77c219f8bc82 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] failed to remove resource iqn.2010-10.org.openstack:a7163a61-f4ba-4976-87e6-77c219f8bc82 because of JDSS resource v_a7163a61-f4ba-4976-87e6-77c219f8bc82 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:42:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] delete target: iqn.2010-10.org.openstack:a7163a61-f4ba-4976-87e6-77c219f8bc82 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:42:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] delete target iqn.2010-10.org.openstack:a7163a61-f4ba-4976-87e6-77c219f8bc82 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:42:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7163a61-f4ba-4976-87e6-77c219f8bc82 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7163a61-f4ba-4976-87e6-77c219f8bc82 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:42:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a7163a61-f4ba-4976-87e6-77c219f8bc82 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7163a61-f4ba-4976-87e6-77c219f8bc82'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7163a61-f4ba-4976-87e6-77c219f8bc82 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:42:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] failed to remove resource iqn.2010-10.org.openstack:a7163a61-f4ba-4976-87e6-77c219f8bc82 because of JDSS resource iqn.2010-10.org.openstack:a7163a61-f4ba-4976-87e6-77c219f8bc82 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:42:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] deleating volume v_a7163a61-f4ba-4976-87e6-77c219f8bc82 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:42:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] get snapshots for volume v_a7163a61-f4ba-4976-87e6-77c219f8bc82 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:42:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7163a61-f4ba-4976-87e6-77c219f8bc82/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:42:59 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7163a61-f4ba-4976-87e6-77c219f8bc82/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7163a61-f4ba-4976-87e6-77c219f8bc82/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] get volume v_a7163a61-f4ba-4976-87e6-77c219f8bc82 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:43:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7163a61-f4ba-4976-87e6-77c219f8bc82 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7163a61-f4ba-4976-87e6-77c219f8bc82 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a7163a61-f4ba-4976-87e6-77c219f8bc82', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681445187', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114286', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4733289293547344082', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6df8ef797d2d58d6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276347904', 'san:volume_id': '6df8ef797d2d58d65bd3b4cd37c5355a29ec4b87', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87354', 'name': 'v_a7163a61-f4ba-4976-87e6-77c219f8bc82', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7163a61-f4ba-4976-87e6-77c219f8bc82 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] delete volume:v_a7163a61-f4ba-4976-87e6-77c219f8bc82 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:43:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7163a61-f4ba-4976-87e6-77c219f8bc82 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7163a61-f4ba-4976-87e6-77c219f8bc82 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7163a61-f4ba-4976-87e6-77c219f8bc82 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] volume v_a7163a61-f4ba-4976-87e6-77c219f8bc82 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:43:01 user cinder-volume[73403]: DEBUG cinder.quota [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Created reservations ['473df9c1-00b2-4f53-abfc-f2fe86cf4e59', '5fd94ed0-168f-4ddb-a4c9-cb934863d8b3', '5216d5bb-2610-4d85-a32f-73c252ced39d', '7e370031-b0d5-49f3-907d-e35bcc5f699a'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:43:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:43:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:43:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276442112', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:02 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:43:02 user cinder-volume[73403]: DEBUG cinder.manager [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:43:02 user cinder-volume[73403]: INFO cinder.volume.manager [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Deleted volume successfully. Apr 14 03:43:02 user cinder-volume[73403]: DEBUG cinder.coordination [None req-d9810a08-3ad5-4cbb-81e2-dfb41986565f tempest-VolumesActionsTest-376578855 None] Lock "cinder-a7163a61-f4ba-4976-87e6-77c219f8bc82-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:43:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:43:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:43:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:43:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276442112', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:43:04 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:43:07 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:43:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Flow 'volume_create_manager' (f1a701ed-15fc-4362-aa79-68124a8c936f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:43:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e06dfa-b8d4-43dc-a512-bc4c29c7eef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e06dfa-b8d4-43dc-a512-bc4c29c7eef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-197434294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=659942f0-3806-4915-8a1f-c012791be35f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97e94ab57fd4483892a2a2c47986eb16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:43:07Z,use_quota=True,user_id='65bc51c1d8f84497917d84575633e352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03445b16-4037-4dda-9c32-8da5c34702dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03445b16-4037-4dda-9c32-8da5c34702dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd5a341-a7ea-4361-868a-0f3253490264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd5a341-a7ea-4361-868a-0f3253490264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '659942f0-3806-4915-8a1f-c012791be35f', 'volume_name': 'volume-659942f0-3806-4915-8a1f-c012791be35f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (209d75e5-4336-4b75-861b-507db9ce1bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (209d75e5-4336-4b75-861b-507db9ce1bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18a9961-29c2-4dbe-8a3e-3f6b2d2ab25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:07 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Volume 659942f0-3806-4915-8a1f-c012791be35f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-659942f0-3806-4915-8a1f-c012791be35f', 'volume_size': 1} Apr 14 03:43:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] creating volume v_659942f0-3806-4915-8a1f-c012791be35f. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:43:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] create volume {'name': 'v_659942f0-3806-4915-8a1f-c012791be35f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:43:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_659942f0-3806-4915-8a1f-c012791be35f', 'is_clone': False, 'name': 'v_659942f0-3806-4915-8a1f-c012791be35f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18a9961-29c2-4dbe-8a3e-3f6b2d2ab25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-659942f0-3806-4915-8a1f-c012791be35f', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:07 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5bbdd7-7ec1-4af9-a758-86a80d3a009e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:08 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Volume volume-659942f0-3806-4915-8a1f-c012791be35f (659942f0-3806-4915-8a1f-c012791be35f): created successfully Apr 14 03:43:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5bbdd7-7ec1-4af9-a758-86a80d3a009e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:08 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Flow 'volume_create_manager' (f1a701ed-15fc-4362-aa79-68124a8c936f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:43:08 user cinder-volume[73403]: INFO cinder.volume.manager [None req-9739b562-92bb-4493-bcd4-0a94601ebe0e tempest-VolumesDeleteCascade-650445149 None] Created volume successfully. Apr 14 03:43:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-04c5eda1-d9a5-4a03-81c6-3f3ac139b233 tempest-VolumesDeleteCascade-650445149 None] create snapshot 88d93f11-9d2b-4ac7-8762-c98c08ce0fea for volume 659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:43:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-04c5eda1-d9a5-4a03-81c6-3f3ac139b233 tempest-VolumesDeleteCascade-650445149 None] cloning v_659942f0-3806-4915-8a1f-c012791be35f to s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:43:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-04c5eda1-d9a5-4a03-81c6-3f3ac139b233 tempest-VolumesDeleteCascade-650445149 None] create snapshot s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:43:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c5eda1-d9a5-4a03-81c6-3f3ac139b233 tempest-VolumesDeleteCascade-650445149 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:08 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c5eda1-d9a5-4a03-81c6-3f3ac139b233 tempest-VolumesDeleteCascade-650445149 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c5eda1-d9a5-4a03-81c6-3f3ac139b233 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_88d93f11-9d2b-4ac7-8762-c98c08ce0fea'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-04c5eda1-d9a5-4a03-81c6-3f3ac139b233 tempest-VolumesDeleteCascade-650445149 None] create volume s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea from snapshot s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:43:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c5eda1-d9a5-4a03-81c6-3f3ac139b233 tempest-VolumesDeleteCascade-650445149 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c5eda1-d9a5-4a03-81c6-3f3ac139b233 tempest-VolumesDeleteCascade-650445149 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c5eda1-d9a5-4a03-81c6-3f3ac139b233 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_659942f0-3806-4915-8a1f-c012791be35f@s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea', 'is_clone': True, 'full_name': 'Pool-0/s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea', 'name': 's_88d93f11-9d2b-4ac7-8762-c98c08ce0fea'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c5eda1-d9a5-4a03-81c6-3f3ac139b233 tempest-VolumesDeleteCascade-650445149 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c5eda1-d9a5-4a03-81c6-3f3ac139b233 tempest-VolumesDeleteCascade-650445149 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-04c5eda1-d9a5-4a03-81c6-3f3ac139b233 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-04c5eda1-d9a5-4a03-81c6-3f3ac139b233 tempest-VolumesDeleteCascade-650445149 None] volume s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:43:10 user cinder-volume[73403]: INFO cinder.volume.manager [None req-04c5eda1-d9a5-4a03-81c6-3f3ac139b233 tempest-VolumesDeleteCascade-650445149 None] Create snapshot completed successfully Apr 14 03:43:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bdcb08ca-0aa7-4fa1-8098-e6f62eb2096e tempest-VolumesDeleteCascade-650445149 None] create snapshot 1194617b-383e-439f-aeb9-97a5589fb927 for volume 659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:43:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bdcb08ca-0aa7-4fa1-8098-e6f62eb2096e tempest-VolumesDeleteCascade-650445149 None] cloning v_659942f0-3806-4915-8a1f-c012791be35f to s_1194617b-383e-439f-aeb9-97a5589fb927 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:43:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bdcb08ca-0aa7-4fa1-8098-e6f62eb2096e tempest-VolumesDeleteCascade-650445149 None] create snapshot s_1194617b-383e-439f-aeb9-97a5589fb927 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:43:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bdcb08ca-0aa7-4fa1-8098-e6f62eb2096e tempest-VolumesDeleteCascade-650445149 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bdcb08ca-0aa7-4fa1-8098-e6f62eb2096e tempest-VolumesDeleteCascade-650445149 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bdcb08ca-0aa7-4fa1-8098-e6f62eb2096e tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_1194617b-383e-439f-aeb9-97a5589fb927'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bdcb08ca-0aa7-4fa1-8098-e6f62eb2096e tempest-VolumesDeleteCascade-650445149 None] create volume s_1194617b-383e-439f-aeb9-97a5589fb927 from snapshot s_1194617b-383e-439f-aeb9-97a5589fb927 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:43:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bdcb08ca-0aa7-4fa1-8098-e6f62eb2096e tempest-VolumesDeleteCascade-650445149 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bdcb08ca-0aa7-4fa1-8098-e6f62eb2096e tempest-VolumesDeleteCascade-650445149 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bdcb08ca-0aa7-4fa1-8098-e6f62eb2096e tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_659942f0-3806-4915-8a1f-c012791be35f@s_1194617b-383e-439f-aeb9-97a5589fb927', 'is_clone': True, 'full_name': 'Pool-0/s_1194617b-383e-439f-aeb9-97a5589fb927', 'name': 's_1194617b-383e-439f-aeb9-97a5589fb927'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bdcb08ca-0aa7-4fa1-8098-e6f62eb2096e tempest-VolumesDeleteCascade-650445149 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1194617b-383e-439f-aeb9-97a5589fb927/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bdcb08ca-0aa7-4fa1-8098-e6f62eb2096e tempest-VolumesDeleteCascade-650445149 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1194617b-383e-439f-aeb9-97a5589fb927/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bdcb08ca-0aa7-4fa1-8098-e6f62eb2096e tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1194617b-383e-439f-aeb9-97a5589fb927/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bdcb08ca-0aa7-4fa1-8098-e6f62eb2096e tempest-VolumesDeleteCascade-650445149 None] volume s_1194617b-383e-439f-aeb9-97a5589fb927 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:43:13 user cinder-volume[73403]: INFO cinder.volume.manager [None req-bdcb08ca-0aa7-4fa1-8098-e6f62eb2096e tempest-VolumesDeleteCascade-650445149 None] Create snapshot completed successfully Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.coordination [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Acquiring lock "cinder-659942f0-3806-4915-8a1f-c012791be35f-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.coordination [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Lock "cinder-659942f0-3806-4915-8a1f-c012791be35f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] remove_export for volume: 659942f0-3806-4915-8a1f-c012791be35f. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-197434294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=659942f0-3806-4915-8a1f-c012791be35f,launched_at=2023-04-14T03:43:08Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97e94ab57fd4483892a2a2c47986eb16',provider_auth='CHAP gfrbecxi ZkOFJCqfuGc0bx',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:659942f0-3806-4915-8a1f-c012791be35f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:43:07Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:43:14Z,updated_at=2023-04-14T03:43:14Z,use_quota=True,user_id='65bc51c1d8f84497917d84575633e352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:659942f0-3806-4915-8a1f-c012791be35f. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] detach volume v_659942f0-3806-4915-8a1f-c012791be35f from target iqn.2010-10.org.openstack:659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:659942f0-3806-4915-8a1f-c012791be35f/luns/v_659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:659942f0-3806-4915-8a1f-c012791be35f/luns/v_659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:659942f0-3806-4915-8a1f-c012791be35f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:659942f0-3806-4915-8a1f-c012791be35f/luns/v_659942f0-3806-4915-8a1f-c012791be35f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:659942f0-3806-4915-8a1f-c012791be35f/luns/v_659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] failed to remove resource iqn.2010-10.org.openstack:659942f0-3806-4915-8a1f-c012791be35f because of JDSS resource v_659942f0-3806-4915-8a1f-c012791be35f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] delete target: iqn.2010-10.org.openstack:659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] delete target iqn.2010-10.org.openstack:659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:659942f0-3806-4915-8a1f-c012791be35f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:659942f0-3806-4915-8a1f-c012791be35f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] failed to remove resource iqn.2010-10.org.openstack:659942f0-3806-4915-8a1f-c012791be35f because of JDSS resource iqn.2010-10.org.openstack:659942f0-3806-4915-8a1f-c012791be35f DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Performing cascade delete. {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1008}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.coordination [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Acquiring lock "cinder-1194617b-383e-439f-aeb9-97a5589fb927-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.coordination [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Lock "cinder-1194617b-383e-439f-aeb9-97a5589fb927-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] deleating snapshot s_1194617b-383e-439f-aeb9-97a5589fb927. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] get snapshots for volume s_1194617b-383e-439f-aeb9-97a5589fb927 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1194617b-383e-439f-aeb9-97a5589fb927/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1194617b-383e-439f-aeb9-97a5589fb927/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1194617b-383e-439f-aeb9-97a5589fb927/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] get volume s_1194617b-383e-439f-aeb9-97a5589fb927 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:43:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1194617b-383e-439f-aeb9-97a5589fb927 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1194617b-383e-439f-aeb9-97a5589fb927 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_659942f0-3806-4915-8a1f-c012791be35f@s_1194617b-383e-439f-aeb9-97a5589fb927', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_1194617b-383e-439f-aeb9-97a5589fb927', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681445201', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114304', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6083490563790058555', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'aacdccb730da7f19', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276323328', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87381', 'name': 's_1194617b-383e-439f-aeb9-97a5589fb927', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1194617b-383e-439f-aeb9-97a5589fb927 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] delete snapshot s_1194617b-383e-439f-aeb9-97a5589fb927 of volume v_659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:43:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/snapshots/s_1194617b-383e-439f-aeb9-97a5589fb927 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:14 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/snapshots/s_1194617b-383e-439f-aeb9-97a5589fb927 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/snapshots/s_1194617b-383e-439f-aeb9-97a5589fb927 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] snapshot s_1194617b-383e-439f-aeb9-97a5589fb927 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:43:16 user cinder-volume[73403]: DEBUG cinder.quota [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Created reservations ['a68f1ff5-12ab-4c7d-976c-7500c4c67dc9', '004687c5-2dec-4dba-a8be-a7e64dfca05d', 'e52ffb72-9fbc-4048-9f89-db2581f59bdf', '5d1ef094-49fb-4d65-b3b8-7bbca1f3a7f1'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:43:16 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=56,cinder:DELETE=4,cinder:UPDATE=34,cinder:INSERT=6 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:43:16 user cinder-volume[73403]: INFO cinder.volume.manager [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Delete snapshot completed successfully. Apr 14 03:43:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Lock "cinder-1194617b-383e-439f-aeb9-97a5589fb927-delete_snapshot" released by "delete_snapshot" :: held 2.310s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:43:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Acquiring lock "cinder-88d93f11-9d2b-4ac7-8762-c98c08ce0fea-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:43:16 user cinder-volume[73403]: DEBUG cinder.coordination [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Lock "cinder-88d93f11-9d2b-4ac7-8762-c98c08ce0fea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:43:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] deleating snapshot s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:43:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] get snapshots for volume s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:43:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] get volume s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:43:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_659942f0-3806-4915-8a1f-c012791be35f@s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681445198', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114298', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1012289217753607060', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ec52a138e6c5365e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276335616', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87365', 'name': 's_88d93f11-9d2b-4ac7-8762-c98c08ce0fea', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] delete snapshot s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea of volume v_659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:43:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/snapshots/s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:16 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/snapshots/s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/snapshots/s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] snapshot s_88d93f11-9d2b-4ac7-8762-c98c08ce0fea deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:43:18 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=64,cinder:INSERT=6,cinder:UPDATE=27,cinder:DELETE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:43:18 user cinder-volume[73403]: DEBUG cinder.quota [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Created reservations ['ce4d514e-a920-4cdc-ae4c-1ed4784ad3d4', '44b70ba1-b071-48ea-b88a-5562131eec5e', '182150b2-e75f-4e56-a785-0d1e7858fab0', 'eb1184e3-54ee-4f14-ae67-9c4b8b9aa6e2'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:43:18 user cinder-volume[73403]: INFO cinder.volume.manager [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Delete snapshot completed successfully. Apr 14 03:43:18 user cinder-volume[73403]: DEBUG cinder.coordination [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Lock "cinder-88d93f11-9d2b-4ac7-8762-c98c08ce0fea-delete_snapshot" released by "delete_snapshot" :: held 2.202s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:43:18 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Snapshots deleted, issuing volume delete {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1023}} Apr 14 03:43:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] deleating volume v_659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:43:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] get snapshots for volume v_659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:43:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] get volume v_659942f0-3806-4915-8a1f-c012791be35f info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:43:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_659942f0-3806-4915-8a1f-c012791be35f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681445196', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114292', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2913517162385772685', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e9cc8d43b4f510f9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276372480', 'san:volume_id': 'e9cc8d43b4f510f9a385bacd095f32a234e075b1', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86952', 'name': 'v_659942f0-3806-4915-8a1f-c012791be35f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] delete volume:v_659942f0-3806-4915-8a1f-c012791be35f recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:43:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:18 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659942f0-3806-4915-8a1f-c012791be35f {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] volume v_659942f0-3806-4915-8a1f-c012791be35f deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:43:20 user cinder-volume[73403]: DEBUG cinder.quota [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Created reservations ['b9d03adf-4798-412f-9f9b-1aad28de9b0a', '0e8c9796-ac56-4618-938a-fa9a5b568363', 'ddd55e90-bd12-4fae-8792-0a1e9c8a8b33', 'aa03d4ba-ff13-4050-8e41-a1e74612ad3c'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:43:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:43:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:43:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:20 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276454400', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:43:21 user cinder-volume[73403]: DEBUG cinder.manager [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:43:21 user cinder-volume[73403]: INFO cinder.volume.manager [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Deleted volume successfully. Apr 14 03:43:21 user cinder-volume[73403]: DEBUG cinder.coordination [None req-417b9521-ebab-4e45-820b-c63766d45a80 tempest-VolumesDeleteCascade-650445149 None] Lock "cinder-659942f0-3806-4915-8a1f-c012791be35f-delete_volume" released by "delete_volume" :: held 7.545s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:43:21 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:43:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Flow 'volume_create_manager' (c39e208e-71a3-48b9-b8d0-d179aa0ff023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:43:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280fc6f6-3533-4a62-81f4-e64db99f901c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280fc6f6-3533-4a62-81f4-e64db99f901c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1796227102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e75cd606-c772-43f5-aed3-7761c7f78847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97e94ab57fd4483892a2a2c47986eb16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:43:22Z,use_quota=True,user_id='65bc51c1d8f84497917d84575633e352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc670583-4e4b-43b4-9fab-e8c9a2008b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc670583-4e4b-43b4-9fab-e8c9a2008b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d9fa5a0-bbd1-472e-8954-e1c0375b56c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d9fa5a0-bbd1-472e-8954-e1c0375b56c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e75cd606-c772-43f5-aed3-7761c7f78847', 'volume_name': 'volume-e75cd606-c772-43f5-aed3-7761c7f78847', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aedc8325-ddce-43be-838a-8e3624587b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aedc8325-ddce-43be-838a-8e3624587b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:21 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a37e3b-65e0-4ad6-8d67-71c633f7fcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:21 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Volume e75cd606-c772-43f5-aed3-7761c7f78847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e75cd606-c772-43f5-aed3-7761c7f78847', 'volume_size': 1} Apr 14 03:43:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] creating volume v_e75cd606-c772-43f5-aed3-7761c7f78847. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:43:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] create volume {'name': 'v_e75cd606-c772-43f5-aed3-7761c7f78847', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:43:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:21 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:22 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e75cd606-c772-43f5-aed3-7761c7f78847', 'is_clone': False, 'name': 'v_e75cd606-c772-43f5-aed3-7761c7f78847'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a37e3b-65e0-4ad6-8d67-71c633f7fcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e75cd606-c772-43f5-aed3-7761c7f78847', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a66cb040-22a3-459c-b9dc-4d27b1d7107c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:22 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Volume volume-e75cd606-c772-43f5-aed3-7761c7f78847 (e75cd606-c772-43f5-aed3-7761c7f78847): created successfully Apr 14 03:43:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a66cb040-22a3-459c-b9dc-4d27b1d7107c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:22 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Flow 'volume_create_manager' (c39e208e-71a3-48b9-b8d0-d179aa0ff023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:43:22 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a39a2356-e068-423c-a72b-b8f0743c7aa3 tempest-VolumesDeleteCascade-650445149 None] Created volume successfully. Apr 14 03:43:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9f99e195-2c33-4586-b4b9-3113b3dfda36 tempest-VolumesDeleteCascade-650445149 None] create snapshot daed1ac3-b8ec-4d34-97a3-7da53fed9065 for volume e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:43:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9f99e195-2c33-4586-b4b9-3113b3dfda36 tempest-VolumesDeleteCascade-650445149 None] cloning v_e75cd606-c772-43f5-aed3-7761c7f78847 to s_daed1ac3-b8ec-4d34-97a3-7da53fed9065 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:43:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9f99e195-2c33-4586-b4b9-3113b3dfda36 tempest-VolumesDeleteCascade-650445149 None] create snapshot s_daed1ac3-b8ec-4d34-97a3-7da53fed9065 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:43:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f99e195-2c33-4586-b4b9-3113b3dfda36 tempest-VolumesDeleteCascade-650445149 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e75cd606-c772-43f5-aed3-7761c7f78847/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:24 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f99e195-2c33-4586-b4b9-3113b3dfda36 tempest-VolumesDeleteCascade-650445149 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e75cd606-c772-43f5-aed3-7761c7f78847/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f99e195-2c33-4586-b4b9-3113b3dfda36 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_daed1ac3-b8ec-4d34-97a3-7da53fed9065'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e75cd606-c772-43f5-aed3-7761c7f78847/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9f99e195-2c33-4586-b4b9-3113b3dfda36 tempest-VolumesDeleteCascade-650445149 None] create volume s_daed1ac3-b8ec-4d34-97a3-7da53fed9065 from snapshot s_daed1ac3-b8ec-4d34-97a3-7da53fed9065 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:43:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f99e195-2c33-4586-b4b9-3113b3dfda36 tempest-VolumesDeleteCascade-650445149 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e75cd606-c772-43f5-aed3-7761c7f78847/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:25 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f99e195-2c33-4586-b4b9-3113b3dfda36 tempest-VolumesDeleteCascade-650445149 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e75cd606-c772-43f5-aed3-7761c7f78847/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f99e195-2c33-4586-b4b9-3113b3dfda36 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_e75cd606-c772-43f5-aed3-7761c7f78847@s_daed1ac3-b8ec-4d34-97a3-7da53fed9065', 'is_clone': True, 'full_name': 'Pool-0/s_daed1ac3-b8ec-4d34-97a3-7da53fed9065', 'name': 's_daed1ac3-b8ec-4d34-97a3-7da53fed9065'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e75cd606-c772-43f5-aed3-7761c7f78847/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f99e195-2c33-4586-b4b9-3113b3dfda36 tempest-VolumesDeleteCascade-650445149 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_daed1ac3-b8ec-4d34-97a3-7da53fed9065/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f99e195-2c33-4586-b4b9-3113b3dfda36 tempest-VolumesDeleteCascade-650445149 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_daed1ac3-b8ec-4d34-97a3-7da53fed9065/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9f99e195-2c33-4586-b4b9-3113b3dfda36 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_daed1ac3-b8ec-4d34-97a3-7da53fed9065/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:26 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9f99e195-2c33-4586-b4b9-3113b3dfda36 tempest-VolumesDeleteCascade-650445149 None] volume s_daed1ac3-b8ec-4d34-97a3-7da53fed9065 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:43:26 user cinder-volume[73403]: INFO cinder.volume.manager [None req-9f99e195-2c33-4586-b4b9-3113b3dfda36 tempest-VolumesDeleteCascade-650445149 None] Create snapshot completed successfully Apr 14 03:43:27 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:43:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Flow 'volume_create_manager' (d3154136-6bc2-4b53-a455-8eb027ae6a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:43:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c0608c-1e36-4cfc-b837-221a1185e2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c0608c-1e36-4cfc-b837-221a1185e2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-486681815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=023a4aa2-d4f6-4532-a2e5-3939fe553864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97e94ab57fd4483892a2a2c47986eb16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=daed1ac3-b8ec-4d34-97a3-7da53fed9065,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:43:27Z,use_quota=True,user_id='65bc51c1d8f84497917d84575633e352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77aca3e0-986d-4fc9-8013-b35c634bef21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77aca3e0-986d-4fc9-8013-b35c634bef21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1278cba3-4bc9-4d2f-9190-4be6f8356376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1278cba3-4bc9-4d2f-9190-4be6f8356376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '023a4aa2-d4f6-4532-a2e5-3939fe553864', 'volume_name': 'volume-023a4aa2-d4f6-4532-a2e5-3939fe553864', 'volume_size': 1, 'snapshot_id': 'daed1ac3-b8ec-4d34-97a3-7da53fed9065'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410b3aab-a563-478f-a163-a01c459958fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410b3aab-a563-478f-a163-a01c459958fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:27 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d3fae2f-ec15-47af-8814-3f99574e0540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:27 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Volume 023a4aa2-d4f6-4532-a2e5-3939fe553864: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-023a4aa2-d4f6-4532-a2e5-3939fe553864', 'volume_size': 1, 'snapshot_id': 'daed1ac3-b8ec-4d34-97a3-7da53fed9065'} Apr 14 03:43:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] create volume 023a4aa2-d4f6-4532-a2e5-3939fe553864 from snapshot daed1ac3-b8ec-4d34-97a3-7da53fed9065 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 03:43:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] cloning s_daed1ac3-b8ec-4d34-97a3-7da53fed9065 to v_023a4aa2-d4f6-4532-a2e5-3939fe553864 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:43:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] create snapshot v_023a4aa2-d4f6-4532-a2e5-3939fe553864 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:43:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_daed1ac3-b8ec-4d34-97a3-7da53fed9065/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:27 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_daed1ac3-b8ec-4d34-97a3-7da53fed9065/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_023a4aa2-d4f6-4532-a2e5-3939fe553864'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_daed1ac3-b8ec-4d34-97a3-7da53fed9065/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] create volume v_023a4aa2-d4f6-4532-a2e5-3939fe553864 from snapshot v_023a4aa2-d4f6-4532-a2e5-3939fe553864 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:43:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_daed1ac3-b8ec-4d34-97a3-7da53fed9065/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:28 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_daed1ac3-b8ec-4d34-97a3-7da53fed9065/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_daed1ac3-b8ec-4d34-97a3-7da53fed9065@v_023a4aa2-d4f6-4532-a2e5-3939fe553864', 'is_clone': True, 'full_name': 'Pool-0/v_023a4aa2-d4f6-4532-a2e5-3939fe553864', 'name': 'v_023a4aa2-d4f6-4532-a2e5-3939fe553864'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_daed1ac3-b8ec-4d34-97a3-7da53fed9065/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] get volume v_023a4aa2-d4f6-4532-a2e5-3939fe553864 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_023a4aa2-d4f6-4532-a2e5-3939fe553864 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_023a4aa2-d4f6-4532-a2e5-3939fe553864 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_daed1ac3-b8ec-4d34-97a3-7da53fed9065@v_023a4aa2-d4f6-4532-a2e5-3939fe553864', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_023a4aa2-d4f6-4532-a2e5-3939fe553864', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681445217', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114329', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3917996551125084505', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c2cb9dd70e3b3591', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276372480', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87407', 'name': 'v_023a4aa2-d4f6-4532-a2e5-3939fe553864', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_023a4aa2-d4f6-4532-a2e5-3939fe553864 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d3fae2f-ec15-47af-8814-3f99574e0540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-023a4aa2-d4f6-4532-a2e5-3939fe553864', 'volume_size': 1, 'snapshot_id': 'daed1ac3-b8ec-4d34-97a3-7da53fed9065'}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8bce03-73d9-4587-9a3c-3c94143716f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:29 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Volume volume-023a4aa2-d4f6-4532-a2e5-3939fe553864 (023a4aa2-d4f6-4532-a2e5-3939fe553864): created successfully Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8bce03-73d9-4587-9a3c-3c94143716f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Flow 'volume_create_manager' (d3154136-6bc2-4b53-a455-8eb027ae6a35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:43:29 user cinder-volume[73403]: INFO cinder.volume.manager [None req-6e29821b-c329-4213-ba02-63a88a5405aa tempest-VolumesDeleteCascade-650445149 None] Created volume successfully. Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Acquiring lock "cinder-e75cd606-c772-43f5-aed3-7761c7f78847-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Lock "cinder-e75cd606-c772-43f5-aed3-7761c7f78847-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] remove_export for volume: e75cd606-c772-43f5-aed3-7761c7f78847. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1796227102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e75cd606-c772-43f5-aed3-7761c7f78847,launched_at=2023-04-14T03:43:23Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97e94ab57fd4483892a2a2c47986eb16',provider_auth='CHAP VmbZyCch FWSM9UOBmp30XI',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75cd606-c772-43f5-aed3-7761c7f78847 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:43:22Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:43:30Z,updated_at=2023-04-14T03:43:30Z,use_quota=True,user_id='65bc51c1d8f84497917d84575633e352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:e75cd606-c772-43f5-aed3-7761c7f78847. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] detach volume v_e75cd606-c772-43f5-aed3-7761c7f78847 from target iqn.2010-10.org.openstack:e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e75cd606-c772-43f5-aed3-7761c7f78847/luns/v_e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e75cd606-c772-43f5-aed3-7761c7f78847/luns/v_e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e75cd606-c772-43f5-aed3-7761c7f78847 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e75cd606-c772-43f5-aed3-7761c7f78847/luns/v_e75cd606-c772-43f5-aed3-7761c7f78847'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e75cd606-c772-43f5-aed3-7761c7f78847/luns/v_e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] failed to remove resource iqn.2010-10.org.openstack:e75cd606-c772-43f5-aed3-7761c7f78847 because of JDSS resource v_e75cd606-c772-43f5-aed3-7761c7f78847 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] delete target: iqn.2010-10.org.openstack:e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] delete target iqn.2010-10.org.openstack:e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e75cd606-c772-43f5-aed3-7761c7f78847 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e75cd606-c772-43f5-aed3-7761c7f78847'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] failed to remove resource iqn.2010-10.org.openstack:e75cd606-c772-43f5-aed3-7761c7f78847 because of JDSS resource iqn.2010-10.org.openstack:e75cd606-c772-43f5-aed3-7761c7f78847 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Performing cascade delete. {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1008}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Acquiring lock "cinder-daed1ac3-b8ec-4d34-97a3-7da53fed9065-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Lock "cinder-daed1ac3-b8ec-4d34-97a3-7da53fed9065-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] deleating snapshot s_daed1ac3-b8ec-4d34-97a3-7da53fed9065. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] get snapshots for volume s_daed1ac3-b8ec-4d34-97a3-7da53fed9065 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_daed1ac3-b8ec-4d34-97a3-7da53fed9065/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:29 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_daed1ac3-b8ec-4d34-97a3-7da53fed9065/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '57344', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 06:06:57', 'volsize': '1073741824', 'createtxg': '114328', 'guid': '9431442070306126', 'compressratio': '1.00', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '0', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.00', 'fscontext': 'none', 'clones': 'Pool-0/v_023a4aa2-d4f6-4532-a2e5-3939fe553864', 'objsetid': '87401', 'name': 'v_023a4aa2-d4f6-4532-a2e5-3939fe553864', 'defer_destroy': 'off', 'mlslabel': 'none', 'logicalreferenced': '28672', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_daed1ac3-b8ec-4d34-97a3-7da53fed9065/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_daed1ac3-b8ec-4d34-97a3-7da53fed9065 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:30 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_daed1ac3-b8ec-4d34-97a3-7da53fed9065 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_daed1ac3-b8ec-4d34-97a3-7da53fed9065 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] volume s_daed1ac3-b8ec-4d34-97a3-7da53fed9065 updated {{(pid=73403) modify_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:267}} Apr 14 03:43:33 user cinder-volume[73403]: DEBUG cinder.quota [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Created reservations ['d2d565f5-e6eb-4bb8-93b1-5ac4bebca0b5', '847132fb-f0a8-49f5-b8a9-86a60b038fb1', '30c25d03-b4dc-4c2c-9daa-9e7bbc63ebd7', 'f92ce8c7-f87a-4931-aea9-3b6508c692fa'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:43:33 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Delete snapshot completed successfully. Apr 14 03:43:33 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Lock "cinder-daed1ac3-b8ec-4d34-97a3-7da53fed9065-delete_snapshot" released by "delete_snapshot" :: held 4.112s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:43:33 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Snapshots deleted, issuing volume delete {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1023}} Apr 14 03:43:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] deleating volume v_e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:43:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] get snapshots for volume v_e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:43:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e75cd606-c772-43f5-aed3-7761c7f78847/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:33 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e75cd606-c772-43f5-aed3-7761c7f78847/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '57344', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 06:06:53', 'volsize': '1073741824', 'createtxg': '114322', 'guid': '6691011715166306528', 'compressratio': '1.00', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '57344', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.00', 'fscontext': 'none', 'clones': 'Pool-0/t_daed1ac3-b8ec-4d34-97a3-7da53fed9065', 'objsetid': '87398', 'name': 's_daed1ac3-b8ec-4d34-97a3-7da53fed9065', 'defer_destroy': 'off', 'san:volume_id': '508a0a77a8d1cf2b8bb1589cde99b9f856118f52', 'mlslabel': 'none', 'logicalreferenced': '28672', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e75cd606-c772-43f5-aed3-7761c7f78847/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:34 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] volume v_e75cd606-c772-43f5-aed3-7761c7f78847 updated {{(pid=73403) modify_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:267}} Apr 14 03:43:36 user cinder-volume[73403]: DEBUG cinder.quota [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Created reservations ['2465dacd-3122-492d-9e04-fccfa9a78965', '36989a80-7673-4c0b-b3b8-73b3809da9ca', '79f67428-adeb-4c23-a5ea-661e0d2bf0ac', 'ce6791a0-781d-41d1-b6db-f357d19d7454'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:43:36 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=52,cinder:INSERT=11,cinder:UPDATE=34,cinder:DELETE=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:43:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:43:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:43:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:36 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276347904', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.manager [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:43:37 user cinder-volume[73403]: INFO cinder.volume.manager [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Deleted volume successfully. Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.coordination [None req-a35b6895-3cbd-42be-90ad-c5bfff226cb8 tempest-VolumesDeleteCascade-650445149 None] Lock "cinder-e75cd606-c772-43f5-aed3-7761c7f78847-delete_volume" released by "delete_volume" :: held 7.353s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.coordination [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Acquiring lock "cinder-023a4aa2-d4f6-4532-a2e5-3939fe553864-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.coordination [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Lock "cinder-023a4aa2-d4f6-4532-a2e5-3939fe553864-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] remove_export for volume: 023a4aa2-d4f6-4532-a2e5-3939fe553864. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-486681815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=023a4aa2-d4f6-4532-a2e5-3939fe553864,launched_at=2023-04-14T03:43:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97e94ab57fd4483892a2a2c47986eb16',provider_auth='CHAP XyIqiJKQ DpYGUE9eOx6PcA',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:023a4aa2-d4f6-4532-a2e5-3939fe553864 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:43:27Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=daed1ac3-b8ec-4d34-97a3-7da53fed9065,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:43:38Z,updated_at=2023-04-14T03:43:38Z,use_quota=True,user_id='65bc51c1d8f84497917d84575633e352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:023a4aa2-d4f6-4532-a2e5-3939fe553864. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] detach volume v_023a4aa2-d4f6-4532-a2e5-3939fe553864 from target iqn.2010-10.org.openstack:023a4aa2-d4f6-4532-a2e5-3939fe553864 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:023a4aa2-d4f6-4532-a2e5-3939fe553864/luns/v_023a4aa2-d4f6-4532-a2e5-3939fe553864 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:023a4aa2-d4f6-4532-a2e5-3939fe553864/luns/v_023a4aa2-d4f6-4532-a2e5-3939fe553864 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:023a4aa2-d4f6-4532-a2e5-3939fe553864 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:023a4aa2-d4f6-4532-a2e5-3939fe553864/luns/v_023a4aa2-d4f6-4532-a2e5-3939fe553864'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:023a4aa2-d4f6-4532-a2e5-3939fe553864/luns/v_023a4aa2-d4f6-4532-a2e5-3939fe553864 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] failed to remove resource iqn.2010-10.org.openstack:023a4aa2-d4f6-4532-a2e5-3939fe553864 because of JDSS resource v_023a4aa2-d4f6-4532-a2e5-3939fe553864 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] delete target: iqn.2010-10.org.openstack:023a4aa2-d4f6-4532-a2e5-3939fe553864 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] delete target iqn.2010-10.org.openstack:023a4aa2-d4f6-4532-a2e5-3939fe553864 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:023a4aa2-d4f6-4532-a2e5-3939fe553864 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:023a4aa2-d4f6-4532-a2e5-3939fe553864 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:023a4aa2-d4f6-4532-a2e5-3939fe553864 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:023a4aa2-d4f6-4532-a2e5-3939fe553864'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:023a4aa2-d4f6-4532-a2e5-3939fe553864 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] failed to remove resource iqn.2010-10.org.openstack:023a4aa2-d4f6-4532-a2e5-3939fe553864 because of JDSS resource iqn.2010-10.org.openstack:023a4aa2-d4f6-4532-a2e5-3939fe553864 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] deleating volume v_023a4aa2-d4f6-4532-a2e5-3939fe553864 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] get snapshots for volume v_023a4aa2-d4f6-4532-a2e5-3939fe553864 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_023a4aa2-d4f6-4532-a2e5-3939fe553864/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:37 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_023a4aa2-d4f6-4532-a2e5-3939fe553864/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_023a4aa2-d4f6-4532-a2e5-3939fe553864/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] get volume v_023a4aa2-d4f6-4532-a2e5-3939fe553864 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:43:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_023a4aa2-d4f6-4532-a2e5-3939fe553864 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_023a4aa2-d4f6-4532-a2e5-3939fe553864 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/t_daed1ac3-b8ec-4d34-97a3-7da53fed9065@v_023a4aa2-d4f6-4532-a2e5-3939fe553864', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_023a4aa2-d4f6-4532-a2e5-3939fe553864', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681445217', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114329', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3917996551125084505', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c2cb9dd70e3b3591', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276347904', 'san:volume_id': 'c2cb9dd70e3b35915440d0b6bce9dc5d61bdecc5', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '87407', 'name': 'v_023a4aa2-d4f6-4532-a2e5-3939fe553864', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_023a4aa2-d4f6-4532-a2e5-3939fe553864 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] get snapshots for volume t_daed1ac3-b8ec-4d34-97a3-7da53fed9065 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:43:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_daed1ac3-b8ec-4d34-97a3-7da53fed9065/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_daed1ac3-b8ec-4d34-97a3-7da53fed9065/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '57344', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 06:06:57', 'volsize': '1073741824', 'createtxg': '114328', 'guid': '9431442070306126', 'compressratio': '1.00', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '0', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.00', 'fscontext': 'none', 'clones': 'Pool-0/v_023a4aa2-d4f6-4532-a2e5-3939fe553864', 'objsetid': '87401', 'name': 'v_023a4aa2-d4f6-4532-a2e5-3939fe553864', 'defer_destroy': 'off', 'mlslabel': 'none', 'logicalreferenced': '28672', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_daed1ac3-b8ec-4d34-97a3-7da53fed9065/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] get volume t_daed1ac3-b8ec-4d34-97a3-7da53fed9065 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:43:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_daed1ac3-b8ec-4d34-97a3-7da53fed9065 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:38 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_daed1ac3-b8ec-4d34-97a3-7da53fed9065 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/t_e75cd606-c772-43f5-aed3-7761c7f78847@s_daed1ac3-b8ec-4d34-97a3-7da53fed9065', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/t_daed1ac3-b8ec-4d34-97a3-7da53fed9065', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681445214', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114323', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14910816929340971723', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '31d459fd4f81b273', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276347904', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86887', 'name': 't_daed1ac3-b8ec-4d34-97a3-7da53fed9065', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_daed1ac3-b8ec-4d34-97a3-7da53fed9065 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] get snapshots for volume t_e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:43:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_e75cd606-c772-43f5-aed3-7761c7f78847/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_e75cd606-c772-43f5-aed3-7761c7f78847/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '57344', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 06:06:53', 'volsize': '1073741824', 'createtxg': '114322', 'guid': '6691011715166306528', 'compressratio': '1.00', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '57344', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.00', 'fscontext': 'none', 'clones': 'Pool-0/t_daed1ac3-b8ec-4d34-97a3-7da53fed9065', 'objsetid': '87398', 'name': 's_daed1ac3-b8ec-4d34-97a3-7da53fed9065', 'defer_destroy': 'off', 'san:volume_id': '508a0a77a8d1cf2b8bb1589cde99b9f856118f52', 'mlslabel': 'none', 'logicalreferenced': '28672', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_e75cd606-c772-43f5-aed3-7761c7f78847/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] get volume t_e75cd606-c772-43f5-aed3-7761c7f78847 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:43:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/t_e75cd606-c772-43f5-aed3-7761c7f78847', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681445211', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114317', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5473316325288727995', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '508a0a77a8d1cf2b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276335616', 'san:volume_id': '508a0a77a8d1cf2b8bb1589cde99b9f856118f52', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86966', 'name': 't_e75cd606-c772-43f5-aed3-7761c7f78847', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] delete volume:t_e75cd606-c772-43f5-aed3-7761c7f78847 recursively children:{'recursively_children': True, 'recursively_dependents': True, 'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:43:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:39 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:40 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Geting {'code': 500, 'error': {'class': 'opene.storage.zfs.ZfsOeError', 'message': 'In order to delete a zvol, you must delete all of its clones first.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_e75cd606-c772-43f5-aed3-7761c7f78847'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_e75cd606-c772-43f5-aed3-7761c7f78847 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:40 user cinder-volume[73403]: DEBUG cinder.coordination [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Lock "cinder-023a4aa2-d4f6-4532-a2e5-3939fe553864-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server [None req-760ca7ac-85b5-4aca-bce4-508a23fe1e99 tempest-VolumesDeleteCascade-650445149 None] Exception during message handling: KeyError: 'errno' Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 203, in wrapper Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, volume, *args, **kwargs) Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 200, in _synchronized Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server return f(*a, **k) Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/objects/cleanable.py", line 208, in wrapper Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server result = f(*args, **kwargs) Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1035, in delete_volume Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server self.force_reraise() Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server raise self.value Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1026, in delete_volume Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server self.driver.delete_volume(volume) Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 286, in delete_volume Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server self._gc_delete(vname) Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 305, in _gc_delete Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server self._delete_back_recursively(jcom.origin_volume(vol['origin']), Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 369, in _delete_back_recursively Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server self._delete_back_recursively( Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 374, in _delete_back_recursively Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server self.ra.delete_lun(opvname, Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 360, in delete_lun Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server if resp["error"]["errno"] == 1000: Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server KeyError: 'errno' Apr 14 03:43:40 user cinder-volume[73403]: ERROR oslo_messaging.rpc.server Apr 14 03:43:43 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:43:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Flow 'volume_create_manager' (4be4536d-b2d3-4cd0-a0f7-b7b183873368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:43:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31987516-58d5-439d-8364-f5b49379acd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31987516-58d5-439d-8364-f5b49379acd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1716043654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=036769cc-706b-4065-8d9f-c80635c07434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de2e8108958440f98b0bb3cfd375949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:43:43Z,use_quota=True,user_id='d83051e38756469ba66320f346d0215a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f916bc5f-8686-44d3-b80d-b5fab871e9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f916bc5f-8686-44d3-b80d-b5fab871e9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05bfc674-6bc6-476c-b2c5-d589e295fd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05bfc674-6bc6-476c-b2c5-d589e295fd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '036769cc-706b-4065-8d9f-c80635c07434', 'volume_name': 'volume-036769cc-706b-4065-8d9f-c80635c07434', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79de7835-cf68-4d3f-82ff-ccd68ebb4457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79de7835-cf68-4d3f-82ff-ccd68ebb4457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:43 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4af2ce7-665b-49b5-a5fb-00f4a1b13529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:43 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Volume 036769cc-706b-4065-8d9f-c80635c07434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-036769cc-706b-4065-8d9f-c80635c07434', 'volume_size': 1} Apr 14 03:43:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] creating volume v_036769cc-706b-4065-8d9f-c80635c07434. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:43:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] create volume {'name': 'v_036769cc-706b-4065-8d9f-c80635c07434', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:43:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:43 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:44 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_036769cc-706b-4065-8d9f-c80635c07434', 'is_clone': False, 'name': 'v_036769cc-706b-4065-8d9f-c80635c07434'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4af2ce7-665b-49b5-a5fb-00f4a1b13529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-036769cc-706b-4065-8d9f-c80635c07434', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42880a5d-ec5b-4538-a7c5-72abe1942565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:44 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Volume volume-036769cc-706b-4065-8d9f-c80635c07434 (036769cc-706b-4065-8d9f-c80635c07434): created successfully Apr 14 03:43:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42880a5d-ec5b-4538-a7c5-72abe1942565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:44 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Flow 'volume_create_manager' (4be4536d-b2d3-4cd0-a0f7-b7b183873368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:43:44 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=65,cinder:UPDATE=28,cinder:INSERT=5,cinder:DELETE=2 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:43:44 user cinder-volume[73403]: INFO cinder.volume.manager [None req-3fd9980c-c1c4-418c-b2c6-c8e8dcd82227 tempest-CreateVolumesFromSnapshotTest-65195143 None] Created volume successfully. Apr 14 03:43:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68d38f03-605e-4c7b-b4ae-65d50e7037fb tempest-CreateVolumesFromSnapshotTest-65195143 None] create snapshot e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7 for volume 036769cc-706b-4065-8d9f-c80635c07434 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 03:43:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68d38f03-605e-4c7b-b4ae-65d50e7037fb tempest-CreateVolumesFromSnapshotTest-65195143 None] cloning v_036769cc-706b-4065-8d9f-c80635c07434 to s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7 {{(pid=73403) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 03:43:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68d38f03-605e-4c7b-b4ae-65d50e7037fb tempest-CreateVolumesFromSnapshotTest-65195143 None] create snapshot s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7 {{(pid=73403) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 03:43:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68d38f03-605e-4c7b-b4ae-65d50e7037fb tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_036769cc-706b-4065-8d9f-c80635c07434/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:45 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68d38f03-605e-4c7b-b4ae-65d50e7037fb tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_036769cc-706b-4065-8d9f-c80635c07434/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68d38f03-605e-4c7b-b4ae-65d50e7037fb tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_036769cc-706b-4065-8d9f-c80635c07434/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68d38f03-605e-4c7b-b4ae-65d50e7037fb tempest-CreateVolumesFromSnapshotTest-65195143 None] create volume s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7 from snapshot s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7 {{(pid=73403) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 03:43:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68d38f03-605e-4c7b-b4ae-65d50e7037fb tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_036769cc-706b-4065-8d9f-c80635c07434/clone {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:46 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68d38f03-605e-4c7b-b4ae-65d50e7037fb tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_036769cc-706b-4065-8d9f-c80635c07434/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68d38f03-605e-4c7b-b4ae-65d50e7037fb tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_036769cc-706b-4065-8d9f-c80635c07434@s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7', 'is_clone': True, 'full_name': 'Pool-0/s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7', 'name': 's_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_036769cc-706b-4065-8d9f-c80635c07434/clone {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68d38f03-605e-4c7b-b4ae-65d50e7037fb tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7/properties {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68d38f03-605e-4c7b-b4ae-65d50e7037fb tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68d38f03-605e-4c7b-b4ae-65d50e7037fb tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7/properties {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68d38f03-605e-4c7b-b4ae-65d50e7037fb tempest-CreateVolumesFromSnapshotTest-65195143 None] volume s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7 properties updated {{(pid=73403) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 03:43:47 user cinder-volume[73403]: INFO cinder.volume.manager [None req-68d38f03-605e-4c7b-b4ae-65d50e7037fb tempest-CreateVolumesFromSnapshotTest-65195143 None] Create snapshot completed successfully Apr 14 03:43:47 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:43:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Flow 'volume_create_manager' (0044062f-e050-410e-829f-d0ea397eec56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:43:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a995796e-2194-478c-9890-d365b789f8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a995796e-2194-478c-9890-d365b789f8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1074860559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e13c2131-241e-4250-9bf3-356b8cb277a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de2e8108958440f98b0bb3cfd375949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:43:48Z,use_quota=True,user_id='d83051e38756469ba66320f346d0215a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0d8f34-fa67-4a20-9c67-9586434c21aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0d8f34-fa67-4a20-9c67-9586434c21aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e54c893-1bba-4eda-baac-ca3a1d19986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e54c893-1bba-4eda-baac-ca3a1d19986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e13c2131-241e-4250-9bf3-356b8cb277a4', 'volume_name': 'volume-e13c2131-241e-4250-9bf3-356b8cb277a4', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5bd107d-8541-4b98-b846-5d10190ad095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5bd107d-8541-4b98-b846-5d10190ad095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:47 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9241e7b-f7cf-498f-a226-1d56bd800dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:47 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Volume e13c2131-241e-4250-9bf3-356b8cb277a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e13c2131-241e-4250-9bf3-356b8cb277a4', 'volume_size': 1} Apr 14 03:43:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] creating volume v_e13c2131-241e-4250-9bf3-356b8cb277a4. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:43:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] create volume {'name': 'v_e13c2131-241e-4250-9bf3-356b8cb277a4', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:43:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:47 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Flow 'volume_create_manager' (4e373522-f541-491b-8d11-0fa9e1d4e4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8cdeecd-7090-494a-b4fa-7f771c30f566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8cdeecd-7090-494a-b4fa-7f771c30f566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1436318725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=650b8cbb-8905-48d9-89e9-02fe741f29ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de2e8108958440f98b0bb3cfd375949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:43:48Z,use_quota=True,user_id='d83051e38756469ba66320f346d0215a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f560d56-3234-480b-9912-903cbb5dc8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f560d56-3234-480b-9912-903cbb5dc8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9433184e-815b-4e58-a43e-17bf30a01fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9433184e-815b-4e58-a43e-17bf30a01fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '650b8cbb-8905-48d9-89e9-02fe741f29ae', 'volume_name': 'volume-650b8cbb-8905-48d9-89e9-02fe741f29ae', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a78db9-a5ae-4112-a14d-08fe53e4f918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a78db9-a5ae-4112-a14d-08fe53e4f918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fcb9da-1628-4482-b2e1-0f828daf302a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Volume 650b8cbb-8905-48d9-89e9-02fe741f29ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-650b8cbb-8905-48d9-89e9-02fe741f29ae', 'volume_size': 1} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] creating volume v_650b8cbb-8905-48d9-89e9-02fe741f29ae. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] create volume {'name': 'v_650b8cbb-8905-48d9-89e9-02fe741f29ae', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Flow 'volume_create_manager' (dc9e6aec-ff5a-4070-ab0e-42ee8503d739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cddf526-70a7-4bd4-b4e6-22d665346ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cddf526-70a7-4bd4-b4e6-22d665346ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-957853973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=850a281a-953c-4339-84a8-a447e7fa3156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de2e8108958440f98b0bb3cfd375949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:43:48Z,use_quota=True,user_id='d83051e38756469ba66320f346d0215a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b422be-b5da-4689-bda6-7a33d7980f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b422be-b5da-4689-bda6-7a33d7980f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4382d192-fa63-4a9e-8217-5a7b998872f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4382d192-fa63-4a9e-8217-5a7b998872f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '850a281a-953c-4339-84a8-a447e7fa3156', 'volume_name': 'volume-850a281a-953c-4339-84a8-a447e7fa3156', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abaa8f7-71c0-4682-b1df-9dd8702090d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abaa8f7-71c0-4682-b1df-9dd8702090d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e80f9c-b341-4010-962e-b868985c2b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Volume 850a281a-953c-4339-84a8-a447e7fa3156: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-850a281a-953c-4339-84a8-a447e7fa3156', 'volume_size': 1} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] creating volume v_850a281a-953c-4339-84a8-a447e7fa3156. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] create volume {'name': 'v_850a281a-953c-4339-84a8-a447e7fa3156', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Flow 'volume_create_manager' (94fba68d-1965-48d5-959d-1ef6e47275ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec274d7-5581-471c-9650-f0f97ed83c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec274d7-5581-471c-9650-f0f97ed83c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-849708904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de2e8108958440f98b0bb3cfd375949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:43:49Z,use_quota=True,user_id='d83051e38756469ba66320f346d0215a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cebb7307-e330-4053-9faa-aa32a512e1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cebb7307-e330-4053-9faa-aa32a512e1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67eae8e-5710-45d3-8333-66f685a4f061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67eae8e-5710-45d3-8333-66f685a4f061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e', 'volume_name': 'volume-fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0499e36a-917a-4344-b3af-139825e72aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0499e36a-917a-4344-b3af-139825e72aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b734d1ce-f040-455a-a1e9-4a45bd0eb6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Volume fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e', 'volume_size': 1} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] creating volume v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] create volume {'name': 'v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.flows.manager.create_volume [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=73403) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Flow 'volume_create_manager' (ad242910-685c-4120-89da-76d4f56aab1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f519b97-9f2e-4837-9936-2eb0440cec88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e13c2131-241e-4250-9bf3-356b8cb277a4', 'is_clone': False, 'name': 'v_e13c2131-241e-4250-9bf3-356b8cb277a4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9241e7b-f7cf-498f-a226-1d56bd800dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e13c2131-241e-4250-9bf3-356b8cb277a4', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277c7416-384f-4f05-b6c1-7db3d742d5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f519b97-9f2e-4837-9936-2eb0440cec88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1120436613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d71f8cb1-5638-4251-83ea-5b7d6c51ba61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de2e8108958440f98b0bb3cfd375949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T03:43:49Z,use_quota=True,user_id='d83051e38756469ba66320f346d0215a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204)' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41ad183-a1b2-46b2-b2d7-0edda64662e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41ad183-a1b2-46b2-b2d7-0edda64662e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9701eda3-33b5-47c4-8f76-1b2c75eeeedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9701eda3-33b5-47c4-8f76-1b2c75eeeedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd71f8cb1-5638-4251-83ea-5b7d6c51ba61', 'volume_name': 'volume-d71f8cb1-5638-4251-83ea-5b7d6c51ba61', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e08f8355-2be5-4cf5-ad58-7443f6ef6d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e08f8355-2be5-4cf5-ad58-7443f6ef6d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149a4aa3-9f48-451f-bd09-da4dd851a768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:48 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Volume d71f8cb1-5638-4251-83ea-5b7d6c51ba61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d71f8cb1-5638-4251-83ea-5b7d6c51ba61', 'volume_size': 1} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] creating volume v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61. {{(pid=73403) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] create volume {'name': 'v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=73403) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:48 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Volume volume-e13c2131-241e-4250-9bf3-356b8cb277a4 (e13c2131-241e-4250-9bf3-356b8cb277a4): created successfully Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277c7416-384f-4f05-b6c1-7db3d742d5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:48 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Flow 'volume_create_manager' (0044062f-e050-410e-829f-d0ea397eec56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:43:48 user cinder-volume[73403]: INFO cinder.volume.manager [None req-d219b377-6117-4a59-83fc-b22af25c9e99 tempest-CreateVolumesFromSnapshotTest-65195143 None] Created volume successfully. Apr 14 03:43:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_850a281a-953c-4339-84a8-a447e7fa3156', 'is_clone': False, 'name': 'v_850a281a-953c-4339-84a8-a447e7fa3156'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e80f9c-b341-4010-962e-b868985c2b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-850a281a-953c-4339-84a8-a447e7fa3156', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d12353f-98c5-4e38-b84e-22bad6943eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:49 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Volume volume-850a281a-953c-4339-84a8-a447e7fa3156 (850a281a-953c-4339-84a8-a447e7fa3156): created successfully Apr 14 03:43:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d12353f-98c5-4e38-b84e-22bad6943eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Flow 'volume_create_manager' (dc9e6aec-ff5a-4070-ab0e-42ee8503d739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:43:49 user cinder-volume[73403]: INFO cinder.volume.manager [None req-c12be39d-5de5-49f6-a23c-79b0a3b326c8 tempest-CreateVolumesFromSnapshotTest-65195143 None] Created volume successfully. Apr 14 03:43:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e', 'is_clone': False, 'name': 'v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b734d1ce-f040-455a-a1e9-4a45bd0eb6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d6861b-e82b-45e5-b671-2b3c15a74fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:49 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Volume volume-fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e (fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e): created successfully Apr 14 03:43:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d6861b-e82b-45e5-b671-2b3c15a74fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Flow 'volume_create_manager' (94fba68d-1965-48d5-959d-1ef6e47275ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:43:49 user cinder-volume[73403]: INFO cinder.volume.manager [None req-36c54c1e-53b9-4782-a070-fffe4b367985 tempest-CreateVolumesFromSnapshotTest-65195143 None] Created volume successfully. Apr 14 03:43:49 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_650b8cbb-8905-48d9-89e9-02fe741f29ae', 'is_clone': False, 'name': 'v_650b8cbb-8905-48d9-89e9-02fe741f29ae'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fcb9da-1628-4482-b2e1-0f828daf302a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-650b8cbb-8905-48d9-89e9-02fe741f29ae', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3dc1b8f-33a2-43c6-a1fc-ffc01bd57413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:49 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Volume volume-650b8cbb-8905-48d9-89e9-02fe741f29ae (650b8cbb-8905-48d9-89e9-02fe741f29ae): created successfully Apr 14 03:43:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3dc1b8f-33a2-43c6-a1fc-ffc01bd57413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:49 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Flow 'volume_create_manager' (4e373522-f541-491b-8d11-0fa9e1d4e4b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:43:49 user cinder-volume[73403]: INFO cinder.volume.manager [None req-881f272e-86c5-4cb4-8aa8-488649db29e2 tempest-CreateVolumesFromSnapshotTest-65195143 None] Created volume successfully. Apr 14 03:43:50 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61', 'is_clone': False, 'name': 'v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149a4aa3-9f48-451f-bd09-da4dd851a768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d71f8cb1-5638-4251-83ea-5b7d6c51ba61', 'volume_size': 1}' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c035cddd-8786-433d-a08e-5acb1281ddac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 03:43:50 user cinder-volume[73403]: INFO cinder.volume.flows.manager.create_volume [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Volume volume-d71f8cb1-5638-4251-83ea-5b7d6c51ba61 (d71f8cb1-5638-4251-83ea-5b7d6c51ba61): created successfully Apr 14 03:43:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c035cddd-8786-433d-a08e-5acb1281ddac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=73403) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 03:43:50 user cinder-volume[73403]: DEBUG cinder.volume.manager [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Flow 'volume_create_manager' (ad242910-685c-4120-89da-76d4f56aab1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=73403) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 03:43:50 user cinder-volume[73403]: INFO cinder.volume.manager [None req-028f2815-7dec-4f2f-8258-f29a25b719a4 tempest-CreateVolumesFromSnapshotTest-65195143 None] Created volume successfully. Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.coordination [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Acquiring lock "cinder-d71f8cb1-5638-4251-83ea-5b7d6c51ba61-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.coordination [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Lock "cinder-d71f8cb1-5638-4251-83ea-5b7d6c51ba61-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] remove_export for volume: d71f8cb1-5638-4251-83ea-5b7d6c51ba61. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1120436613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d71f8cb1-5638-4251-83ea-5b7d6c51ba61,launched_at=2023-04-14T03:43:51Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de2e8108958440f98b0bb3cfd375949',provider_auth='CHAP cuqhNgmK Uq5ILNsBHGZ37X',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d71f8cb1-5638-4251-83ea-5b7d6c51ba61 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:43:49Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:43:51Z,updated_at=2023-04-14T03:43:51Z,use_quota=True,user_id='d83051e38756469ba66320f346d0215a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:d71f8cb1-5638-4251-83ea-5b7d6c51ba61. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] detach volume v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61 from target iqn.2010-10.org.openstack:d71f8cb1-5638-4251-83ea-5b7d6c51ba61 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d71f8cb1-5638-4251-83ea-5b7d6c51ba61/luns/v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d71f8cb1-5638-4251-83ea-5b7d6c51ba61/luns/v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d71f8cb1-5638-4251-83ea-5b7d6c51ba61 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d71f8cb1-5638-4251-83ea-5b7d6c51ba61/luns/v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d71f8cb1-5638-4251-83ea-5b7d6c51ba61/luns/v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] failed to remove resource iqn.2010-10.org.openstack:d71f8cb1-5638-4251-83ea-5b7d6c51ba61 because of JDSS resource v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] delete target: iqn.2010-10.org.openstack:d71f8cb1-5638-4251-83ea-5b7d6c51ba61 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] delete target iqn.2010-10.org.openstack:d71f8cb1-5638-4251-83ea-5b7d6c51ba61 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d71f8cb1-5638-4251-83ea-5b7d6c51ba61 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d71f8cb1-5638-4251-83ea-5b7d6c51ba61 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d71f8cb1-5638-4251-83ea-5b7d6c51ba61 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d71f8cb1-5638-4251-83ea-5b7d6c51ba61'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d71f8cb1-5638-4251-83ea-5b7d6c51ba61 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] failed to remove resource iqn.2010-10.org.openstack:d71f8cb1-5638-4251-83ea-5b7d6c51ba61 because of JDSS resource iqn.2010-10.org.openstack:d71f8cb1-5638-4251-83ea-5b7d6c51ba61 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] deleating volume v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] get snapshots for volume v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] get volume v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681445239', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114362', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3021989202473811518', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8c52c292e1debd30', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275807232', 'san:volume_id': '8c52c292e1debd30884b1542c48570ec31e352dc', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86778', 'name': 'v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] delete volume:v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:51 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] volume v_d71f8cb1-5638-4251-83ea-5b7d6c51ba61 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:43:53 user cinder-volume[73403]: DEBUG cinder.quota [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Created reservations ['97f644d7-33dd-4d1c-b28d-a170c98e7bc1', 'cec36e4e-cdda-4cf1-b786-bfc9d1aa8342', 'e9f8becb-fdb9-4ba1-97f8-8cea14b42050', '091411f8-ea53-45ec-a40e-4d537ada9f58'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:43:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:43:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:43:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:53 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'available': '114275889152', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.manager [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:43:54 user cinder-volume[73403]: INFO cinder.volume.manager [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Deleted volume successfully. Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.coordination [None req-726f8450-f347-4d96-ab79-88b9c60bbb78 tempest-CreateVolumesFromSnapshotTest-65195143 None] Lock "cinder-d71f8cb1-5638-4251-83ea-5b7d6c51ba61-delete_volume" released by "delete_volume" :: held 2.982s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.coordination [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Acquiring lock "cinder-fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.coordination [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Lock "cinder-fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] remove_export for volume: fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-849708904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e,launched_at=2023-04-14T03:43:50Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de2e8108958440f98b0bb3cfd375949',provider_auth='CHAP iTQouIwU trE1DQqcwf90YG',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:43:49Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:43:54Z,updated_at=2023-04-14T03:43:54Z,use_quota=True,user_id='d83051e38756469ba66320f346d0215a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] detach volume v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e from target iqn.2010-10.org.openstack:fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e/luns/v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e/luns/v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e/luns/v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e/luns/v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] failed to remove resource iqn.2010-10.org.openstack:fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e because of JDSS resource v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] delete target: iqn.2010-10.org.openstack:fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] delete target iqn.2010-10.org.openstack:fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] failed to remove resource iqn.2010-10.org.openstack:fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e because of JDSS resource iqn.2010-10.org.openstack:fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] deleating volume v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] get snapshots for volume v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:54 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] get volume v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:43:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681445238', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114353', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17549152400802315229', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '949d9e38d2c3501c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275889152', 'san:volume_id': '949d9e38d2c3501c6de06980d39cf626e6de04e6', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87943', 'name': 'v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] delete volume:v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:43:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:55 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:56 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] volume v_fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:43:56 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=64,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=3 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:43:56 user cinder-volume[73403]: DEBUG cinder.quota [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Created reservations ['4a12dcdb-1f05-4135-9ac1-ca49dfca26f1', '01e3ab6c-017a-4efa-8b28-d8468a2770c3', 'dce87e10-d2ea-42c6-b722-ffa9d29ae0b0', '5459ed9a-f100-4078-9099-cbc5ee43ba9d'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'available': '114275971072', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.manager [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:43:57 user cinder-volume[73403]: INFO cinder.volume.manager [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Deleted volume successfully. Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.coordination [None req-4e01d88d-e4dd-46cd-a02b-40478f9982cc tempest-CreateVolumesFromSnapshotTest-65195143 None] Lock "cinder-fe80b9d9-7c74-4fb7-ab8f-d6d9bc9b7c3e-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.coordination [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Acquiring lock "cinder-850a281a-953c-4339-84a8-a447e7fa3156-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.coordination [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Lock "cinder-850a281a-953c-4339-84a8-a447e7fa3156-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=54,cinder:UPDATE=35,cinder:DELETE=6,cinder:INSERT=5 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] remove_export for volume: 850a281a-953c-4339-84a8-a447e7fa3156. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-957853973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=850a281a-953c-4339-84a8-a447e7fa3156,launched_at=2023-04-14T03:43:50Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de2e8108958440f98b0bb3cfd375949',provider_auth='CHAP lNzXQIwi T8VCxmDYdJys27',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:850a281a-953c-4339-84a8-a447e7fa3156 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:43:48Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:43:58Z,updated_at=2023-04-14T03:43:58Z,use_quota=True,user_id='d83051e38756469ba66320f346d0215a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:850a281a-953c-4339-84a8-a447e7fa3156. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] detach volume v_850a281a-953c-4339-84a8-a447e7fa3156 from target iqn.2010-10.org.openstack:850a281a-953c-4339-84a8-a447e7fa3156 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:850a281a-953c-4339-84a8-a447e7fa3156/luns/v_850a281a-953c-4339-84a8-a447e7fa3156 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:850a281a-953c-4339-84a8-a447e7fa3156/luns/v_850a281a-953c-4339-84a8-a447e7fa3156 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:850a281a-953c-4339-84a8-a447e7fa3156 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:850a281a-953c-4339-84a8-a447e7fa3156/luns/v_850a281a-953c-4339-84a8-a447e7fa3156'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:850a281a-953c-4339-84a8-a447e7fa3156/luns/v_850a281a-953c-4339-84a8-a447e7fa3156 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] failed to remove resource iqn.2010-10.org.openstack:850a281a-953c-4339-84a8-a447e7fa3156 because of JDSS resource v_850a281a-953c-4339-84a8-a447e7fa3156 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] delete target: iqn.2010-10.org.openstack:850a281a-953c-4339-84a8-a447e7fa3156 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] delete target iqn.2010-10.org.openstack:850a281a-953c-4339-84a8-a447e7fa3156 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:850a281a-953c-4339-84a8-a447e7fa3156 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:850a281a-953c-4339-84a8-a447e7fa3156 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:850a281a-953c-4339-84a8-a447e7fa3156 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:850a281a-953c-4339-84a8-a447e7fa3156'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:850a281a-953c-4339-84a8-a447e7fa3156 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] failed to remove resource iqn.2010-10.org.openstack:850a281a-953c-4339-84a8-a447e7fa3156 because of JDSS resource iqn.2010-10.org.openstack:850a281a-953c-4339-84a8-a447e7fa3156 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] deleating volume v_850a281a-953c-4339-84a8-a447e7fa3156 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] get snapshots for volume v_850a281a-953c-4339-84a8-a447e7fa3156 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_850a281a-953c-4339-84a8-a447e7fa3156/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:57 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_850a281a-953c-4339-84a8-a447e7fa3156/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_850a281a-953c-4339-84a8-a447e7fa3156/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] get volume v_850a281a-953c-4339-84a8-a447e7fa3156 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:43:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_850a281a-953c-4339-84a8-a447e7fa3156 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_850a281a-953c-4339-84a8-a447e7fa3156 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:43:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_850a281a-953c-4339-84a8-a447e7fa3156', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681445237', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114350', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13290974439712119865', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b55f3818100c0f3c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114275971072', 'san:volume_id': 'b55f3818100c0f3cf34729f419daadebee7be8f4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87423', 'name': 'v_850a281a-953c-4339-84a8-a447e7fa3156', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_850a281a-953c-4339-84a8-a447e7fa3156 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:43:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] delete volume:v_850a281a-953c-4339-84a8-a447e7fa3156 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:43:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_850a281a-953c-4339-84a8-a447e7fa3156 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:43:58 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_850a281a-953c-4339-84a8-a447e7fa3156 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_850a281a-953c-4339-84a8-a447e7fa3156 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] volume v_850a281a-953c-4339-84a8-a447e7fa3156 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:44:00 user cinder-volume[73403]: DEBUG cinder.quota [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Created reservations ['e5a43cf3-0b3d-4a54-a293-d6321463e39f', '85acd9a6-e829-4d00-a578-5b65d25a9285', '2450b260-5afb-4459-bc09-f8344de442aa', '39a366ec-a2e3-47e4-9b8f-60c756e939e7'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:44:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:44:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:44:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276065280', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:44:00 user cinder-volume[73403]: DEBUG cinder.manager [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:44:00 user cinder-volume[73403]: INFO cinder.volume.manager [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Deleted volume successfully. Apr 14 03:44:00 user cinder-volume[73403]: DEBUG cinder.coordination [None req-90c8d87a-609b-465f-90d1-816b366f8578 tempest-CreateVolumesFromSnapshotTest-65195143 None] Lock "cinder-850a281a-953c-4339-84a8-a447e7fa3156-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:44:00 user cinder-volume[73403]: DEBUG cinder.coordination [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Acquiring lock "cinder-650b8cbb-8905-48d9-89e9-02fe741f29ae-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:44:00 user cinder-volume[73403]: DEBUG cinder.coordination [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Lock "cinder-650b8cbb-8905-48d9-89e9-02fe741f29ae-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:44:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] remove_export for volume: 650b8cbb-8905-48d9-89e9-02fe741f29ae. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:44:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:44:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1436318725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=650b8cbb-8905-48d9-89e9-02fe741f29ae,launched_at=2023-04-14T03:43:50Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de2e8108958440f98b0bb3cfd375949',provider_auth='CHAP pjGLIFyE WmSnJ53EZC87lI',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:650b8cbb-8905-48d9-89e9-02fe741f29ae 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:43:48Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:44:01Z,updated_at=2023-04-14T03:44:01Z,use_quota=True,user_id='d83051e38756469ba66320f346d0215a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:650b8cbb-8905-48d9-89e9-02fe741f29ae. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:44:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] detach volume v_650b8cbb-8905-48d9-89e9-02fe741f29ae from target iqn.2010-10.org.openstack:650b8cbb-8905-48d9-89e9-02fe741f29ae {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:44:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:650b8cbb-8905-48d9-89e9-02fe741f29ae/luns/v_650b8cbb-8905-48d9-89e9-02fe741f29ae {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:650b8cbb-8905-48d9-89e9-02fe741f29ae/luns/v_650b8cbb-8905-48d9-89e9-02fe741f29ae {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:00 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:650b8cbb-8905-48d9-89e9-02fe741f29ae not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:650b8cbb-8905-48d9-89e9-02fe741f29ae/luns/v_650b8cbb-8905-48d9-89e9-02fe741f29ae'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:650b8cbb-8905-48d9-89e9-02fe741f29ae/luns/v_650b8cbb-8905-48d9-89e9-02fe741f29ae {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] failed to remove resource iqn.2010-10.org.openstack:650b8cbb-8905-48d9-89e9-02fe741f29ae because of JDSS resource v_650b8cbb-8905-48d9-89e9-02fe741f29ae DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:44:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] delete target: iqn.2010-10.org.openstack:650b8cbb-8905-48d9-89e9-02fe741f29ae {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:44:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] delete target iqn.2010-10.org.openstack:650b8cbb-8905-48d9-89e9-02fe741f29ae {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:44:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:650b8cbb-8905-48d9-89e9-02fe741f29ae {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:650b8cbb-8905-48d9-89e9-02fe741f29ae {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:650b8cbb-8905-48d9-89e9-02fe741f29ae not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:650b8cbb-8905-48d9-89e9-02fe741f29ae'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:650b8cbb-8905-48d9-89e9-02fe741f29ae {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] failed to remove resource iqn.2010-10.org.openstack:650b8cbb-8905-48d9-89e9-02fe741f29ae because of JDSS resource iqn.2010-10.org.openstack:650b8cbb-8905-48d9-89e9-02fe741f29ae DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:44:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] deleating volume v_650b8cbb-8905-48d9-89e9-02fe741f29ae {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:44:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] get snapshots for volume v_650b8cbb-8905-48d9-89e9-02fe741f29ae {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:44:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_650b8cbb-8905-48d9-89e9-02fe741f29ae/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_650b8cbb-8905-48d9-89e9-02fe741f29ae/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_650b8cbb-8905-48d9-89e9-02fe741f29ae/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] get volume v_650b8cbb-8905-48d9-89e9-02fe741f29ae info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:44:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_650b8cbb-8905-48d9-89e9-02fe741f29ae {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_650b8cbb-8905-48d9-89e9-02fe741f29ae {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_650b8cbb-8905-48d9-89e9-02fe741f29ae', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681445238', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114356', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17677679594138584180', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7e6be8bf1a9ed78d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276065280', 'san:volume_id': '7e6be8bf1a9ed78d4c7970ff02d9591f36850050', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '87951', 'name': 'v_650b8cbb-8905-48d9-89e9-02fe741f29ae', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_650b8cbb-8905-48d9-89e9-02fe741f29ae {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] delete volume:v_650b8cbb-8905-48d9-89e9-02fe741f29ae recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:44:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_650b8cbb-8905-48d9-89e9-02fe741f29ae {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:01 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_650b8cbb-8905-48d9-89e9-02fe741f29ae {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_650b8cbb-8905-48d9-89e9-02fe741f29ae {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] volume v_650b8cbb-8905-48d9-89e9-02fe741f29ae deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:44:03 user cinder-volume[73403]: DEBUG cinder.quota [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Created reservations ['422da18f-631b-4652-9a3d-bb6c6e4e5873', '0e479e96-eb3d-47fc-a02c-040e53e824d7', '0501dfe7-6213-4e06-adc1-7773abbb04e0', '11805dd9-a6d2-46d1-a18e-d717245d8ce6'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:44:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:44:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:44:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:03 user cinder-volume[73403]: DEBUG oslo_service.periodic_task [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73403) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 03:44:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:44:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:44:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114276065280', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:44:03 user cinder-volume[73403]: DEBUG cinder.manager [None req-887564c1-3382-4023-8b49-b9ae63f31515 None None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:44:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276134912', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:03 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:44:03 user cinder-volume[73403]: DEBUG cinder.manager [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:44:03 user cinder-volume[73403]: INFO cinder.volume.manager [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Deleted volume successfully. Apr 14 03:44:03 user cinder-volume[73403]: DEBUG cinder.coordination [None req-61e5ea8f-9386-48b2-af1b-5fea59197275 tempest-CreateVolumesFromSnapshotTest-65195143 None] Lock "cinder-650b8cbb-8905-48d9-89e9-02fe741f29ae-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.coordination [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Acquiring lock "cinder-e13c2131-241e-4250-9bf3-356b8cb277a4-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.coordination [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Lock "cinder-e13c2131-241e-4250-9bf3-356b8cb277a4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] remove_export for volume: e13c2131-241e-4250-9bf3-356b8cb277a4. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1074860559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e13c2131-241e-4250-9bf3-356b8cb277a4,launched_at=2023-04-14T03:43:49Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de2e8108958440f98b0bb3cfd375949',provider_auth='CHAP ydlHIXxm IchunTOlSiEmok',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13c2131-241e-4250-9bf3-356b8cb277a4 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:43:48Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:44:04Z,updated_at=2023-04-14T03:44:04Z,use_quota=True,user_id='d83051e38756469ba66320f346d0215a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:e13c2131-241e-4250-9bf3-356b8cb277a4. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] detach volume v_e13c2131-241e-4250-9bf3-356b8cb277a4 from target iqn.2010-10.org.openstack:e13c2131-241e-4250-9bf3-356b8cb277a4 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e13c2131-241e-4250-9bf3-356b8cb277a4/luns/v_e13c2131-241e-4250-9bf3-356b8cb277a4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e13c2131-241e-4250-9bf3-356b8cb277a4/luns/v_e13c2131-241e-4250-9bf3-356b8cb277a4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e13c2131-241e-4250-9bf3-356b8cb277a4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e13c2131-241e-4250-9bf3-356b8cb277a4/luns/v_e13c2131-241e-4250-9bf3-356b8cb277a4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e13c2131-241e-4250-9bf3-356b8cb277a4/luns/v_e13c2131-241e-4250-9bf3-356b8cb277a4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] failed to remove resource iqn.2010-10.org.openstack:e13c2131-241e-4250-9bf3-356b8cb277a4 because of JDSS resource v_e13c2131-241e-4250-9bf3-356b8cb277a4 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] delete target: iqn.2010-10.org.openstack:e13c2131-241e-4250-9bf3-356b8cb277a4 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] delete target iqn.2010-10.org.openstack:e13c2131-241e-4250-9bf3-356b8cb277a4 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e13c2131-241e-4250-9bf3-356b8cb277a4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e13c2131-241e-4250-9bf3-356b8cb277a4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e13c2131-241e-4250-9bf3-356b8cb277a4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e13c2131-241e-4250-9bf3-356b8cb277a4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e13c2131-241e-4250-9bf3-356b8cb277a4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] failed to remove resource iqn.2010-10.org.openstack:e13c2131-241e-4250-9bf3-356b8cb277a4 because of JDSS resource iqn.2010-10.org.openstack:e13c2131-241e-4250-9bf3-356b8cb277a4 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] deleating volume v_e13c2131-241e-4250-9bf3-356b8cb277a4 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] get snapshots for volume v_e13c2131-241e-4250-9bf3-356b8cb277a4 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e13c2131-241e-4250-9bf3-356b8cb277a4/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e13c2131-241e-4250-9bf3-356b8cb277a4/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e13c2131-241e-4250-9bf3-356b8cb277a4/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] get volume v_e13c2131-241e-4250-9bf3-356b8cb277a4 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e13c2131-241e-4250-9bf3-356b8cb277a4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e13c2131-241e-4250-9bf3-356b8cb277a4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e13c2131-241e-4250-9bf3-356b8cb277a4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681445237', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114346', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15878539819751832187', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9bc32ceed7f7374f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276134912', 'san:volume_id': '9bc32ceed7f7374f35eb42f1edbc25241b79bd6f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86998', 'name': 'v_e13c2131-241e-4250-9bf3-356b8cb277a4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e13c2131-241e-4250-9bf3-356b8cb277a4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] delete volume:v_e13c2131-241e-4250-9bf3-356b8cb277a4 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e13c2131-241e-4250-9bf3-356b8cb277a4 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:04 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e13c2131-241e-4250-9bf3-356b8cb277a4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e13c2131-241e-4250-9bf3-356b8cb277a4 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] volume v_e13c2131-241e-4250-9bf3-356b8cb277a4 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:44:06 user cinder-volume[73403]: DEBUG cinder.quota [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Created reservations ['089d1d30-ec8d-4ca2-8e0b-5884d0636eaa', 'df056a4b-fea0-437f-a067-726a88fd53ad', '03967324-9257-4196-b114-9a95bb6e302c', 'dbdb5851-cbfc-4bc5-baf3-0540de240c06'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:44:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:44:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:44:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:06 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276204544', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:44:07 user cinder-volume[73403]: DEBUG cinder.manager [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:44:07 user cinder-volume[73403]: INFO cinder.volume.manager [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Deleted volume successfully. Apr 14 03:44:07 user cinder-volume[73403]: DEBUG cinder.coordination [None req-d8a95b06-5d1b-41f0-9eba-7be020528388 tempest-CreateVolumesFromSnapshotTest-65195143 None] Lock "cinder-e13c2131-241e-4250-9bf3-356b8cb277a4-delete_volume" released by "delete_volume" :: held 3.174s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:44:07 user cinder-volume[73403]: DEBUG cinder.coordination [None req-1b378067-9a5a-48a9-a3db-98de37688434 tempest-CreateVolumesFromSnapshotTest-65195143 None] Acquiring lock "cinder-e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7-delete_snapshot" by "delete_snapshot" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:44:07 user cinder-volume[73403]: DEBUG cinder.coordination [None req-1b378067-9a5a-48a9-a3db-98de37688434 tempest-CreateVolumesFromSnapshotTest-65195143 None] Lock "cinder-e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:44:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1b378067-9a5a-48a9-a3db-98de37688434 tempest-CreateVolumesFromSnapshotTest-65195143 None] deleating snapshot s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7. {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 03:44:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1b378067-9a5a-48a9-a3db-98de37688434 tempest-CreateVolumesFromSnapshotTest-65195143 None] get snapshots for volume s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:44:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b378067-9a5a-48a9-a3db-98de37688434 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b378067-9a5a-48a9-a3db-98de37688434 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b378067-9a5a-48a9-a3db-98de37688434 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1b378067-9a5a-48a9-a3db-98de37688434 tempest-CreateVolumesFromSnapshotTest-65195143 None] get volume s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:44:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b378067-9a5a-48a9-a3db-98de37688434 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b378067-9a5a-48a9-a3db-98de37688434 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b378067-9a5a-48a9-a3db-98de37688434 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_036769cc-706b-4065-8d9f-c80635c07434@s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681445235', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114342', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7570836577369745639', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9eac144a12282c56', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276204544', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '86986', 'name': 's_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1b378067-9a5a-48a9-a3db-98de37688434 tempest-CreateVolumesFromSnapshotTest-65195143 None] delete snapshot s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7 of volume v_036769cc-706b-4065-8d9f-c80635c07434 {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 03:44:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b378067-9a5a-48a9-a3db-98de37688434 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_036769cc-706b-4065-8d9f-c80635c07434/snapshots/s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:07 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b378067-9a5a-48a9-a3db-98de37688434 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_036769cc-706b-4065-8d9f-c80635c07434/snapshots/s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1b378067-9a5a-48a9-a3db-98de37688434 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_036769cc-706b-4065-8d9f-c80635c07434/snapshots/s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:09 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1b378067-9a5a-48a9-a3db-98de37688434 tempest-CreateVolumesFromSnapshotTest-65195143 None] snapshot s_e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7 deleted {{(pid=73403) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 03:44:09 user cinder-volume[73403]: DEBUG cinder.quota [None req-1b378067-9a5a-48a9-a3db-98de37688434 tempest-CreateVolumesFromSnapshotTest-65195143 None] Created reservations ['1ca0a79d-42f0-4fe2-9f1a-b034c8bbc86d', '1f7c1f47-6410-4b63-a84a-3528d3018a9a', 'adb97bc4-0f3b-4ff2-bc31-13063b9d48ca', 'c8f41549-e02e-4983-a2b1-3cd943649467'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:44:09 user cinder-volume[73403]: INFO cinder.volume.manager [None req-1b378067-9a5a-48a9-a3db-98de37688434 tempest-CreateVolumesFromSnapshotTest-65195143 None] Delete snapshot completed successfully. Apr 14 03:44:09 user cinder-volume[73403]: DEBUG cinder.coordination [None req-1b378067-9a5a-48a9-a3db-98de37688434 tempest-CreateVolumesFromSnapshotTest-65195143 None] Lock "cinder-e5ba53a6-4f86-4da1-b1a8-8ab4d93c76a7-delete_snapshot" released by "delete_snapshot" :: held 2.450s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 03:44:10 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Acquiring lock "cinder-036769cc-706b-4065-8d9f-c80635c07434-delete_volume" by "delete_volume" {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 03:44:10 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Lock "cinder-036769cc-706b-4065-8d9f-c80635c07434-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 03:44:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] remove_export for volume: 036769cc-706b-4065-8d9f-c80635c07434. {{(pid=73403) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 03:44:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] remove export {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 03:44:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T03:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1716043654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=036769cc-706b-4065-8d9f-c80635c07434,launched_at=2023-04-14T03:43:44Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de2e8108958440f98b0bb3cfd375949',provider_auth='CHAP QlmUICFh dLfsic7u42rlZ6',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:036769cc-706b-4065-8d9f-c80635c07434 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T03:43:43Z,service_uuid='5b27d925-ca7b-471b-a924-326b3e3c4710',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T03:44:11Z,updated_at=2023-04-14T03:44:11Z,use_quota=True,user_id='d83051e38756469ba66320f346d0215a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(add04113-84a3-47ba-8fde-ec2400cf3204),volume_type_id=add04113-84a3-47ba-8fde-ec2400cf3204) from target:iqn.2010-10.org.openstack:036769cc-706b-4065-8d9f-c80635c07434. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 03:44:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] detach volume v_036769cc-706b-4065-8d9f-c80635c07434 from target iqn.2010-10.org.openstack:036769cc-706b-4065-8d9f-c80635c07434 {{(pid=73403) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 03:44:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:036769cc-706b-4065-8d9f-c80635c07434/luns/v_036769cc-706b-4065-8d9f-c80635c07434 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:036769cc-706b-4065-8d9f-c80635c07434/luns/v_036769cc-706b-4065-8d9f-c80635c07434 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:036769cc-706b-4065-8d9f-c80635c07434 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:036769cc-706b-4065-8d9f-c80635c07434/luns/v_036769cc-706b-4065-8d9f-c80635c07434'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:036769cc-706b-4065-8d9f-c80635c07434/luns/v_036769cc-706b-4065-8d9f-c80635c07434 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] failed to remove resource iqn.2010-10.org.openstack:036769cc-706b-4065-8d9f-c80635c07434 because of JDSS resource v_036769cc-706b-4065-8d9f-c80635c07434 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 03:44:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] delete target: iqn.2010-10.org.openstack:036769cc-706b-4065-8d9f-c80635c07434 {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 03:44:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] delete target iqn.2010-10.org.openstack:036769cc-706b-4065-8d9f-c80635c07434 {{(pid=73403) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 03:44:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:036769cc-706b-4065-8d9f-c80635c07434 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:036769cc-706b-4065-8d9f-c80635c07434 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:036769cc-706b-4065-8d9f-c80635c07434 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:036769cc-706b-4065-8d9f-c80635c07434'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:036769cc-706b-4065-8d9f-c80635c07434 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] failed to remove resource iqn.2010-10.org.openstack:036769cc-706b-4065-8d9f-c80635c07434 because of JDSS resource iqn.2010-10.org.openstack:036769cc-706b-4065-8d9f-c80635c07434 DNE. {{(pid=73403) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 03:44:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] deleating volume v_036769cc-706b-4065-8d9f-c80635c07434 {{(pid=73403) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 03:44:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] get snapshots for volume v_036769cc-706b-4065-8d9f-c80635c07434 {{(pid=73403) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 03:44:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_036769cc-706b-4065-8d9f-c80635c07434/snapshots {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:10 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_036769cc-706b-4065-8d9f-c80635c07434/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_036769cc-706b-4065-8d9f-c80635c07434/snapshots {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] get volume v_036769cc-706b-4065-8d9f-c80635c07434 info {{(pid=73403) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 03:44:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_036769cc-706b-4065-8d9f-c80635c07434 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_036769cc-706b-4065-8d9f-c80635c07434 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_036769cc-706b-4065-8d9f-c80635c07434', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681445232', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '114336', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16321142544245340637', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '552dc43a9cb24d2c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114276204544', 'san:volume_id': '552dc43a9cb24d2cf006b6eaafd86da6e435bd0e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '86973', 'name': 'v_036769cc-706b-4065-8d9f-c80635c07434', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_036769cc-706b-4065-8d9f-c80635c07434 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] delete volume:v_036769cc-706b-4065-8d9f-c80635c07434 recursively children:{'force_umount': True} {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 03:44:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_036769cc-706b-4065-8d9f-c80635c07434 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:11 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_036769cc-706b-4065-8d9f-c80635c07434 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_036769cc-706b-4065-8d9f-c80635c07434 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] volume v_036769cc-706b-4065-8d9f-c80635c07434 deleted {{(pid=73403) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 03:44:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:DELETE=3,cinder:SELECT=55,cinder:UPDATE=33,cinder:INSERT=9 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:44:12 user cinder-volume[73403]: DEBUG cinder.quota [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Created reservations ['68217737-fbba-4dd6-97c9-79cf9bdb6bd8', '92b5d0db-bcc8-4cdb-a3f7-de80da701ed1', '97a5604b-82b6-47df-82bc-b672d73d10b1', 'e085e770-07e3-40e5-8e76-2fe1ec545a36'] {{(pid=73403) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 03:44:12 user cinder-volume[73403]: DEBUG dbcounter [-] [73403] Writing DB stats cinder:SELECT=56,cinder:INSERT=11,cinder:UPDATE=32,cinder:DELETE=1 {{(pid=73403) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 03:44:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Updating volume stats {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 03:44:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Get pool Pool-0 fsprops {{(pid=73403) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 03:44:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 03:44:12 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 03:44:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Geting {'code': 200, 'error': None, 'data': {'available': '114276298752', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=73403) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 03:44:13 user cinder-volume[73403]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Total capacity: 119, Free 106. {{(pid=73403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 03:44:13 user cinder-volume[73403]: DEBUG cinder.manager [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Notifying Schedulers of capabilities ... {{(pid=73403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:44:13 user cinder-volume[73403]: INFO cinder.volume.manager [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Deleted volume successfully. Apr 14 03:44:13 user cinder-volume[73403]: DEBUG cinder.coordination [None req-ae34a899-660c-43ba-a0c8-3a6c762db617 tempest-CreateVolumesFromSnapshotTest-65195143 None] Lock "cinder-036769cc-706b-4065-8d9f-c80635c07434-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=73403) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}